Spectating data service for a spectating system

ABSTRACT

A spectating system that stores audiovisual (A/V) content for broadcasts and collects and stores spectating data including spectator interactions with the broadcasts and broadcast content, and that exposes the data and A/V content to consumers such as game developers, online merchants, or broadcasters. The spectating system temporally correlates the spectating data and A/V content so that consumers can review portions of video, audio, and/or text from broadcasts that may be related to particular spectator behaviors as indicated by respective spectating data. The spectating data may also be spatially mapped to the spectating interface so that consumers can determine spectator interest in and interactions with various broadcast content. The spectating data may include data specific to a broadcast, a plurality of broadcasts, a game, or a plurality of games.

BACKGROUND

Evolution of the Internet, Web-based computing, and mobile computing,including the increasingly widespread availability of broadbandconnections, support for high-resolution video, and the availability andcapabilities of consumer computing devices including but not limited tomobile computing devices such as pad/tablet devices and smartphones, hasled to continuing evolution and growth of online gaming. Online gamesmay include everything from relatively simple, two-dimensional (2D)casual games to more complex 2D or three-dimensional (3D) action,sports, or strategy games that may involve one or more players in a gamesession, to multiplayer online battle arena (MOBA) games, toworld-building multiplayer games, to complex 3D massively multiplayeronline games (MMOGs) such as massively multiplayer online role-playinggames (MMORPGs) that may support hundreds or thousands of active playersin a persistent online “world”.

The continued evolution and growth of online gaming has in turn led tothe rise in popularity of video game spectating, or virtual spectating.In virtual spectating, one or more viewers or spectators may watch thegame play of one or more other players actively participating in anonline game without themselves actively participating in the game play.For example, in a multiplayer online game, spectators may watch one ormore players or teams of players involved in a battle or otherwiseparticipating in game play. Broadband Internet, high-resolution video,and video streaming technologies have led to the development of livebroadcasting technologies that may be leveraged to provide onlinevirtual spectating for online games. For example, a game spectatingsystem may allow players to broadcast live or recorded streams of theirgame play to tens, hundreds, or thousands of spectators, while allowingthe spectators to select the live or recorded broadcasts of particularplayers for viewing.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1A is a block diagram that illustrates integrating game systemswith a game spectating system in a game spectating environment,according to some embodiments.

FIG. 1B is a block diagram that illustrates an example broadcast contentservice in a game spectating environment, according to some embodiments.

FIG. 1C is a block diagram that illustrates sources for game metadata ina game spectating environment, according to some embodiments.

FIG. 1D is a block diagram that illustrates an example game systemarchitecture, according to some embodiments.

FIG. 2A is a flowchart of a method for determining and presentingbroadcast content in a game spectating environment as illustrated inFIG. 1A, according to some embodiments.

FIG. 2B is a flowchart of a method for determining and presentingbroadcast content in a game spectating environment as illustrated inFIG. 1B, according to some embodiments.

FIG. 3A illustrates event detection and processing in a game spectatingsystem, according to some embodiments.

FIG. 3B illustrates game event processing in a game spectating system,according to some embodiments.

FIG. 3C illustrates participant event tag processing in a gamespectating system, according to some embodiments.

FIG. 3D illustrates processing participant inputs to determine events ina game spectating system, according to some embodiments.

FIG. 4 illustrates processing participant inputs to determinebroadcast-related information in a game spectating system, according tosome embodiments.

FIG. 5 is a flowchart of a method for determining events in a gamespectating environment, according to some embodiments.

FIGS. 6A and 6B provide non-limiting examples of a spectating userinterface for a game spectating system, according to some embodiments.

FIGS. 7A and 7B provide non-limiting examples of a spectating userinterface for a game spectating system, according to some embodiments.

FIG. 8 provides a non-limiting example of a broadcaster user interfacefor a game spectating system, according to some embodiments.

FIG. 9 provides another non-limiting example of a spectating userinterface for a game spectating system, according to some embodiments.

FIG. 10 illustrates an example virtual storefront module in a gamespectating system, according to some embodiments.

FIG. 11 is a flowchart of a method for providing game-relatedmerchandise via a game spectating system, according to some embodiments.

FIG. 12 provides a non-limiting example of a game merchandisinginterface for a game spectating system, according to some embodiments.

FIGS. 13A through 13E illustrate provisioning game client software andgame states to a spectator device in a game spectating environment,according to some embodiments.

FIG. 14 provides a non-limiting example of a game participationinterface for a game spectating system, according to some embodiments.

FIG. 15A is a flowchart of a method for facilitating game acquisitionand participation via a game spectating system, according to someembodiments.

FIG. 15B is a flowchart of a method for stepping into a game via a gamespectating system, according to some embodiments.

FIG. 15C is a flowchart of a method for cloning and provisioning a gamecharacter, according to some embodiments.

FIG. 15D is a flowchart of a method for provisioning game clientsoftware to a spectator device in a game spectating environment,according to some embodiments.

FIG. 15E is a flowchart of a method for obtaining game data on aspectator device, according to some embodiments.

FIG. 16 illustrates an example participant rewards module in a gamespectating environment, according to some embodiments.

FIG. 17A is a high-level flowchart of a method for recognizing orrewarding participants in a game spectating environment, according tosome embodiments.

FIG. 17B is a flowchart of a method for rewarding participants innotable events in games being broadcast, according to some embodiments.

FIG. 18 provides a non-limiting example of achievements and rewardsinterfaces for a game spectating system, according to some embodiments.

FIG. 19A illustrates an example game effects module in a game spectatingsystem that provides inputs to a game being broadcast via the gamespectating system based on spectator inputs to and interactions with thebroadcast, according to some embodiments.

FIG. 19B illustrates example game input modules on a game system thatprocess spectating data received from a spectating system to generateinputs to a game being broadcast via the game spectating system,according to some embodiments.

FIGS. 20A through 20D are flowcharts of methods for generating inputs toa game system from spectators' interactions with broadcasts in a gamespectating system, according to some embodiments.

FIG. 21 provides a non-limiting example of a game spectating systeminterface that allows spectators to collectively affect a game beingbroadcast via the game spectating system, according to some embodiments.

FIG. 22 provides a non-limiting example of spectators' inputs to abroadcast in a game spectating system collectively affecting a gamebeing broadcast via the game spectating system, according to someembodiments.

FIG. 23 illustrates an example game interaction module in a gamespectating system that allows a spectator to provide inputs that affecta game being broadcast via the game spectating system, according to someembodiments.

FIG. 24A is a flowchart of a method for allowing spectators to provideinputs that affect a game being broadcast in a game spectating system,according to some embodiments.

FIG. 24B is a flowchart of a method for analyzing spectator audio ortext inputs to affect a game being broadcast in a game spectatingsystem, according to some embodiments.

FIG. 25 provides a non-limiting example of a spectating user interfacefor a game spectating system that allows spectators to provide inputsthat affect a game being broadcast via a game spectating system,according to some embodiments.

FIG. 26A provides another non-limiting example of a spectating userinterface for a game spectating system that allows spectator andspectating community inputs to affect a game being broadcast via thegame spectating system, according to some embodiments.

FIG. 26B provides a non-limiting example of a broadcaster user interfacefor a game spectating system that allows spectator and spectatingcommunity inputs to affect a game being broadcast via the gamespectating system, according to some embodiments.

FIG. 27 illustrates collecting and storing game spectating data in agame spectating system, according to some embodiments.

FIG. 28 illustrates an example game spectating module or service thatexposes game spectating data to consumers in a game spectating system,according to some embodiments.

FIG. 29 is a flowchart of a method for collecting game spectating dataand exposing the data to consumers in a game spectating system,according to some embodiments.

FIG. 30 is a non-limiting example of a game spectating data consumerinterface that shows a heat map overlaid on a spectating interfaceindicating spectator interactions with broadcast content, according tosome embodiments.

FIG. 31 is a non-limiting example of a game spectating data consumerinterface that shows game spectating metrics correlated with broadcastA/V content, according to some embodiments.

FIG. 32 illustrates example network-based game spectating environments,according to some embodiments.

FIG. 33 is a block diagram illustrating an example computer system thatmay be used in some embodiments.

While embodiments are described herein by way of example for severalembodiments and illustrative drawings, those skilled in the art willrecognize that embodiments are not limited to the embodiments ordrawings described. It should be understood, that the drawings anddetailed description thereto are not intended to limit embodiments tothe particular form disclosed, but on the contrary, the intention is tocover all modifications, equivalents and alternatives falling within thespirit and scope as defined by the appended claims. The headings usedherein are for organizational purposes only and are not meant to be usedto limit the scope of the description or the claims. As used throughoutthis application, the word “may” is used in a permissive sense (i.e.,meaning having the potential to), rather than the mandatory sense (i.e.,meaning must). Similarly, the words “include”, “including”, and“includes” mean including, but not limited to.

DETAILED DESCRIPTION Introduction

Various embodiments of methods and apparatus for integrating gamesystems with a game spectating system in a game spectating environmentare described. In a game spectating environment, a game spectatingsystem may receive broadcasts of players' game play from broadcasterdevices and stream the broadcasts to spectator devices for viewing byrespective viewers, referred to herein as spectators. A broadcast mayinclude video showing game play of a respective broadcasterparticipating as a player in a game executing on a game system.Embodiments may include methods and apparatus for game systems toprovide game metadata to the game spectating system in addition to thebroadcast streams. Embodiments may also include methods and apparatusfor providing content to spectators via the spectating system interfacebased at least in part on the game metadata acquired or obtained fromthe game system(s). Embodiments may also include methods and apparatusfor enabling spectator participation to affect the games being broadcastvia the spectating system interface.

Game spectating systems may include network-based video streamingsystems or services that may allow game players to broadcast livestreams of their game play to tens, hundreds, thousands or morespectators, while allowing the spectators to select the broadcasts ofparticular players (also referred to as channels) for viewing. A gamespectating system may support live streaming of broadcast from tens,hundreds, or thousands of players simultaneously. A game spectatingsystem may record at least some live broadcasts and allow the recordedbroadcasts to be played back for viewing by spectators. A gamespectating system may support live and recorded broadcasts for one, two,or more different online games.

Online games are network-based games that may allow one, two, or moreplayers, in some cases even thousands of players, to simultaneouslyparticipate in a game from consumer devices coupled to a network. Onlinegames that may be implemented in game spectating environments asdescribed herein may vary from tightly scripted games to games thatintroduce varying amounts of randomness to the game play. An online gamemay, for example, be a game in which the players attempt to achieve somegoal or overcome some obstacle, and may include multiple levels that theplayers have to overcome. An online game may, for example, be a game inwhich the players cooperate to achieve goals or overcome obstacles, or agame in which one or more of the players compete against one or moreother players, either as teams or as individuals. Alternatively, anonline game may be a game in which the players may more passivelyexplore and make discoveries within a complex game universe without anyparticular goals in mind, or a “world-building” online game in which theplayers may actively modify their environments within the game universe.Online games may include everything from relatively simple,two-dimensional (2D) casual games to more complex 2D orthree-dimensional (3D) action, sports, or strategy games, to multiplayeronline battle arena (MOBA) games, to complex 3D massively multiplayeronline games (MMOGs) such as massively multiplayer online role-playinggames (MMORPGs) that may simultaneously support hundreds or thousands ofplayers in a persistent online “world”.

In this document, the term “player” is generally used to refer to anactual human that actively participates in an online game, the term“broadcaster” is generally used to refer to a player who broadcasts astream of their game play via the game spectating system, the terms“viewer” or “spectator” are generally used to refer to an actual humanthat watches live or recorded game play online without directlyparticipating in the game as a player, the term “participant” isgenerally used to collectively refer to players (active participants)and spectators (passive participants), the term “client” (as in “clientdevice”, “game client”, “broadcasting client”, and “spectating client”)is generally used to refer to a hardware and/or software interface to agame system or streaming system via which a participant interacts withthe game system and/or spectating system, and the term “character” or“game character” is generally used to refer to a player's in-gamepresence or “avatar” that the player may control via a game client on aclient device to interact with other game characters, other gameentities, and other objects within the game environment during a gamesession.

While embodiments are primarily described herein in the context ofspectating systems that broadcast game play in multiplayer online gamingenvironments in which two or more players remotely participate in onlinegame sessions, it is to be noted that embodiments may also be applied tosingle-player online games, as well as to single-player and multiplayergames that are not necessarily online, such as single-player andmultiplayer console games that may be played locally/offline. Further,while embodiments are primarily described with examples of streaminglive or recorded broadcasts of games involving players with in-gamecharacters or avatars such as action, sports, MOBA, and MMOG games,embodiments may be applied to live and recorded streams of any type ofgame, for example card games or strategy games such as chess, with anynumber of players from single-player games to MMOGs. In addition, insome embodiments, a spectating system may support broadcasts or streamsof live and/or recorded digital media content from sources other thangame systems, for example from live sports games, competitions,concerts, talk shows, and other events or activities including but notlimited to live streams from electronic spectator sports (eSports)competitions, and embodiments may also be applied to these broadcasts orstreams. Further, while embodiments are primarily described in thecontext of live streams or video, embodiments may also be applied topreviously recorded streams or video.

In some embodiments of a spectating system, spectators may be dividedinto two or more groups, tiers, or levels. As non-limiting examples ofgroupings for spectators, spectators may be divided into subscribers andnon-subscribers, or viewers, followers, and subscribers. A subscriber isa viewer or spectator who has signed up for (and generally but notnecessarily pays for) at least some of the services spectating system asa service. A viewer or non-subscriber is someone who may view at leastsome content from the spectating system, but that has not necessarilyregistered with, subscribed to, or paid for the service to receiveadditional or full content or services provided to subscribers. Afollower may be a person who has registered with the spectating system,that has registered as a “follower” of spectating system content(broadcast, broadcaster, channel, game, etc.), that may participate as aspectator in broadcasts, and that may receive some benefits (e.g.,notifications via social media channels for events in broadcasts) as afollower, but that has not subscribed to the spectating system toreceive full subscription benefits. In addition, there may be multiplelevels or tiers for groups or subscribers, such as a first (e.g.,“silver”) membership level that provides some amount of content andservices, and a second (e.g., “gold”) membership that provides more (orall) content and services, for example for a higher membership fee or asa reward for participating in broadcasts. Note that spectators may begrouped according to any of various other criteria. As non-limitingexamples, spectators may be grouped by geographic region, affiliations,age, length of participation with the spectating system, or any ofvarious demographic and profile metrics.

In some embodiments, in addition to broadcaster/players and spectators,participants in an online gaming environment may include commentators. Acommentator may be a spectator who watches live or recorded game playwithout directly participating in the game. However, a commentator maygenerally be someone that is knowledgeable about the game and thatprovides audio commentary on the game being watched, for example gameanalysis, player analysis, and play-by-play commentary. One or morecommentators may provide audio and/or textual commentary for a givengame being broadcast in a spectating system, and the commentary may beadded to the broadcasts streamed to the spectators.

In at least some embodiments, a game spectating system may obtain gamemetadata from game systems for which broadcasts are being streamed,generate content (referred to as broadcast content) for respectivebroadcasts at least in part from the game metadata, and present thebroadcast content with the respective broadcasts to spectators viaspectator interfaces on the spectators' devices. The broadcast contentmay be targeted to particular spectators or groups of spectators, forexample according to the spectators' current selections, profiles, orpreferences. In some embodiments, the spectating system may obtain andprocess spectator interactions with the broadcast content to affectbroadcast presentation in the spectating system and/or game executionand game play in the game system in various ways.

In some embodiments, the game metadata may be received according to anapplication programming interface (API) presented to the game systems bythe spectating system, referred to herein as a game system API. The gamesystem API allows game developers to program games to interact withspectating system functionality as described herein. In someembodiments, a software development kit (SDK) may be provided thatassists game developers in developing and programming games to supportthe spectating system's game system API. In some embodiments, the gamemetadata for a given game system may include one or more of, but is notlimited to, game state(s) for the game executing on the game system,indications and descriptions of events in the game, player inputs to thegame, and data describing or representing objects, players/characters,locations, levels, and other content or aspects of the game. In someembodiments, at least some of the game metadata, for example gamestates, may be provided in response to requests from the spectatingsystem. In some embodiments, the spectating system may also obtain orreceive game metadata from other sources, including but not limited tobroadcast devices and data stores of game-related data.

A game state may be a point-in-time record of game information and gamedata that represents a particular game at a particular point on the gametimeline within the game universe. A game state may include game datathat represents and that can be used, for example by a game clientexecuting on a device, to reconstruct the game at the particular pointon the game timeline within the game. In at least some embodiments, gamestates may be received according to a game system API presented to thegame systems by the spectating system. In some embodiments, one or moregame states may be used to regenerate the game session universe, forexample to begin or resume game play at the respective point in the gamesession timeline. Note that format and content of a game state may bedifferent for different types, titles, or versions of games.

In at least some embodiments, indications of game events may be receivedfrom the game systems according to a game system API presented to thegame systems by the spectating system. Game events may include eventsthat are common across two or more games. However, at least some gameevents may be game-specific events as defined by a respective gamesystems. Examples of game events may include, but are not limited to:particular achievements by particular players or teams of players; levelstarts and completions; beginnings, endings, or other significantmoments of battles, bouts, challenges, or other in-game events; in-gamecharacter entrances, exits, deaths, etc.; acquisitions or loss of items,objects, powers, etc. by in-game characters or players; or in generalany event or moment that may be of interest within a game executing on agame system.

In at least some embodiments, indications of player inputs to the gamefor at least some of the players in the game may be received from thegame systems according to the game system API presented to the gamesystems by the spectating system. A player input may be a single commandor action input to the game from a respective player's game client orgame controller. A player input or a combination of player inputs maycause, be involved in, or be associated with a game event. In someembodiments, player inputs to a game may be stored as part of a gamerecord with one or more game states and other game information to form arecord of a particular game session (referred to as a game record) thatmay, for example, be vended to clients including but not limited tospectators. A game record including player inputs may be replayed, andin some embodiments a viewer of a replay may “step into” the replay asdescribed later in this document.

In addition to receiving and processing game metadata from the gamesystem(s) to generate broadcast content, in some embodiments thespectating system may obtain and analyze various inputs fromparticipants (players, broadcasters, and/or spectators) in the gamespectating environment to detect events in or determine otherinformation about the broadcasts and/or games executing on the gamesystems. The events and other information determined from analyzing theparticipant inputs may collectively be referred to as broadcastmetadata. The spectating system may generate broadcast content forrespective broadcasts at least in part from the broadcast metadata, andmay present the broadcast content with the respective broadcasts toparticipants including but not limited to spectators via interfaces onrespective devices. The various participant inputs may include one ormore of, but are not limited to: audio or voice inputs such as in-gamevocal communications or broadcast vocal channels; video or image inputs(e.g., video or images of a participant's facial expressions or eyes);text input such as in-game or broadcast text chat; biometric inputs fromthe players; and participant inputs to a broadcast via spectating userinterfaces (UIs), for example inputs indicating or voting on in-game orbroadcast events as highlights for the broadcasts and/or games.

The generated broadcast content that may be presented with therespective broadcasts to spectators via spectator interfaces on thespectators' devices may include one or more of various user interface(UI) elements (e.g., buttons, dialogs, lists, tabs, menus, images, videoclips, links, text, panes that include one or more other UI elements,etc.) that may be presented on a UI with the broadcast video, and/or oneor more overlays (e.g., overlay video, text, etc.) that may be added tothe broadcast video. At least some of the UI elements may be or mayinclude active UI elements that initiate or perform some action whenselected.

In some embodiments, spectator interactions with the broadcast contentmay be tracked, processed, and recorded as additional broadcast metadataor as spectating data. The spectator interactions may include one ormore of, but are not limited to, selecting a UI element, manipulating aUI element (e.g., by scrolling, clicking, sliding, turning, etc.),hovering (e.g., with a cursor) over or near a UI element, inputting to aUI element (e.g., entering text in a text box), and focusing on one ormore UI elements (e.g., as detected via eye tracking technology).

In some embodiments, the broadcast content may be presented to thespectators via spectating system client instances on the spectators'devices as provided by the spectating system. In some embodiments, thebroadcast content may instead or also be provided to variousapplications executing on the spectators' devices according to anapplication programming interface (API) presented to the applications bythe spectating system.

In some embodiments, instead of or in addition to the spectating systemadding broadcast content to a broadcast, a system, module, or service(referred to herein as a broadcast content service) may logically liebetween the spectating system and spectator devices. The broadcastcontent service may receive broadcast streams, broadcast metadata, andgame metadata from the spectating system, and may add or modifybroadcast content to the broadcast streams based at least in part on thegame metadata and/or broadcast metadata.

In some embodiments, the spectating system may leverage the gamemetadata to provide a virtual storefront for game-related content viawhich spectators may view, select, and order, purchase, or otherwiseobtain game-related content. The game-related content may includevirtual game items or objects (e.g., digital representations of physicalobjects) such as in-game gear, clothing, weapons, characters, avatars,powers, and so on, that may be acquired for use within the games,physical items such as physical representations of virtual objects fromwithin the games (e.g., physical swords, action figures, toys, etc.),and/or game-related physical merchandise such as t-shirts, posters,videos, or hats. In some embodiments, the spectating system may provide,or may provide access to, a “print on demand” service whereby 3Dprinting technology may be used to print physical objects based on inputdesigns or specifications of game-related objects or items (e.g.,in-game characters, weapons, vehicles, monsters, etc.). The designs orspecifications for the objects may be obtained from the game systems inthe game metadata, or may be otherwise obtained. The virtual storefrontmay provide a user interface (UI) whereby spectators can viewinformation about the in-game content, for example statistics on whichcharacters/players use an item, how they use it, the item's history orsuccess, and so on. The spectating system may provide text and/or voicechat channels via which the spectators and broadcasters may discuss thegame-related items available via the virtual storefront. In someembodiments, a broadcaster may select or specify particular items orobjects that are advertised or sold via the virtual storefront UI on thebroadcaster's channel.

In some embodiments, the spectating system may leverage the gamemetadata to allow spectators to join or “step into” games beingbroadcast via the spectating system. In some embodiments, the broadcastcontent presented to the spectators on a spectating UI may include userinterface elements via which spectators can order, purchase, orotherwise obtain demo or full versions of games. In some embodiments,game client software and game data for participating in demo or fullversions of online games may be obtained and downloaded to thespectator's devices via the spectating system interfaces and broadcaststreams. In some embodiments, the broadcast content presented to thespectators on a spectating UI may include user interface elements viawhich spectators can order, purchase, or otherwise obtain characters,avatars, gear, and other items for participation in particular games.The obtained characters and game items may be downloaded to thespectators' devices via the spectating system interfaces and broadcaststreams. In some embodiments, using the spectating UI to obtain the gameclient software, game data, characters, and gear via the broadcaststreams, the spectators may join live game sessions of online games,start new game sessions, and/or replay previously recorded game sessionsor portions of game sessions.

In some embodiments, the spectators may use the spectating UI to obtainthe game client software, game data, characters, and gear via thebroadcast streams, and may also obtain, “step into”, and replay previousgame sessions or portions of game sessions. In some embodiments, gamestates can be purchased or otherwise obtained via the spectating systeminterfaces and broadcast streams. In some embodiments, the broadcastcontent presented to the spectators on a spectating UI may include userinterface elements via which one or more game states, for example thegame states provided with the game metadata, may be advertised, obtainedby the spectator, and used to regenerate the game session universe andstart or resume game play at the respective point in the game sessiontimeline, with the spectator becoming a player and stepping into thegame session universe and timeline, either using their own in-gamecharacter or avatar or stepping into and taking control of a characterthat is already in the game session. In some embodiments, the broadcastcontent presented to the spectators on a spectating UI may include userinterface elements via which spectators can view, order, purchase, orotherwise obtain characters, avatars, and gear of players whoparticipate in particular games. Thus, in some embodiments, a spectatorcan obtain an in-game character and “load out” or equip the character,obtain an executable version of the game, obtain and “step into” gamestates, and step into or become characters or clones of characters inthe game sessions, all via the spectating system interfaces and streams.

In some embodiments, a “ghosting” mode may be supported when replayinggame sessions from obtained game states or game records. In ghostingmode, a player may jump into a game being broadcast, or replay apreviously recorded game session of a broadcaster/player, via thespectating system interface. The original player's character/gear (e.g.,racecar) may still be visible as a “ghost” to the new player. Thus, thenew player may compare their performance to that of the original playerby viewing the original player's “ghost” during replay. In addition, theoriginal player's broadcast commentary (video, audio, and/or text) maybe played or displayed to the new player. As an example, the new playermay use the ghosting mode as a training tool to learn how a skilled oraccomplished broadcaster/player has played a difficult level orchallenge within the game.

In some embodiments, the spectating system may leverage the gamemetadata and/or broadcast metadata to provide rewards or otherwiseacknowledge spectating system participants (broadcaster/players,spectators, and/or commentators). In some embodiments, spectators may berewarded for participating in broadcasts or in particular events inbroadcasts or games being broadcast. In some embodiments, the spectatingsystem may analyze the game metadata and/or broadcast metadata to detectbig or significant events or highlights in broadcast streams, and mayreward at least some spectators for “being there” or viewing the bigevents. In some embodiments, spectators may be rewarded for interactingwith broadcasters, for example for actively participating in broadcastaudio or text chat channels. Examples of spectator rewards may includebut are not limited to acknowledgements or “badging” on the gamespectating system interface, virtual or digital items such as in-gamevirtual gear, discounts or free access to spectating system or gamecontent, physical items such as t-shirts or hats, and points that may becollected and used to purchase items or win prizes. In some embodiments,the spectating system may allow broadcasters to reward or promoteparticular spectators, for example by selecting a spectator who showsgood knowledge of the game to be a commentator for the game. In someembodiments, broadcaster/players may be rewarded for particularaccomplishments, for example in-game achievements such as performingcertain feats in front of crowds of certain sizes, or achieving certainlevels of audience participation or support (audience size, enthusiasm,voting, etc.). As non-limiting examples, a broadcaster/player may get anin-game health or strength boost or may be rewarded with in-game powers,gear, weapons, or information based on a growing audience size oraudience enthusiasm as expressed through audio and/or textual spectatorchat input. As another example, a broadcaster may get special broadcastcontent added to their broadcast channel display based on theirachievements. As another example, a broadcaster may receive monetaryrewards for bringing in new followers or subscribers to the spectatingsystem through their broadcast channel.

In some embodiments, the spectating system may enable spectatorparticipation in broadcasts to affect the games being broadcast via thespectating system interface in various ways. In some embodiments, thespectating system may determine information based on spectatorparticipation in broadcasts and provide the information as feedback tothe game systems according to a game system API presented to the gamesystems by the spectating system. Spectator participation metrics thatmay be used include but are not limited to crowd or audience size forbroadcasts or games, and spectator audio and/or text input to broadcast“chat”, “crowd noise”, or other audio and textual channels. In someembodiments, spectator participation in broadcasts may be used as arandomizing factor in games. For example, one or more aspects or metricsof spectator participation in a broadcast or broadcasts (crowd oraudience size, crowd noise, chat level or volume, etc.) may be measuredor tracked and provided as feedback to a game system for use as a gamerandomizing factor. In some embodiments, spectator participation inbroadcasts may be used to non-randomly affect the game players and/orgames being broadcast in various ways. As a non-limiting example, thesize of a crowd or audience watching a broadcast or broadcasts of anevent in a game may be fed back to the game and may dictate the size orappearance of the stadium, arena or other event venue, the size of avirtual crowd of spectators shown as viewing the event, and/or thevolume of the crowd noise provided as audio output with the broadcast.As another example, the level of crowd enthusiasm or support, forexample as measured from the volume, quantity, or content of audioand/or text chat channel inputs to a broadcast, may be fed back to thegame and may affect the number of “bad guys” or monsters that appear atthe current level that the broadcaster/player is at, or may be used toreward the broadcaster at the level by giving the player access tocertain weapons, or may have various other in-game effects. As anotherexample, spectators' audio and/or textual inputs may be analyzed todetect content or emotion (keywords, cheers, boos, happiness, etc.); theanalysis may be fed back to the game and used to affect a player'sin-game status, health, power, weapons, etc.

In some embodiments, the spectating system may enable spectators tointeract with and affect the games being broadcast via the spectatingsystem interface, or the players within the games, in various ways. Insome embodiments, individual spectators may interact with the games viathe game spectating interface to cause in-game effects. In someembodiments, groups of spectators may cause in-game effects or otherwiseinfluence the game via the game spectating interface, for example basedon voting. In some embodiments, the spectating system may leverage thegame metadata to provide spectating UI elements with which spectatorscan interact to provide input to respective games. In some embodiments,the spectating system may provide the spectator interactions as feedbackto the game systems according to a game system API presented to the gamesystems by the spectating system. In some embodiments, spectators mayaffect or influence the game, objects within the game universe, eventswithin the game, or the players in the game via the UI elements on thegame spectating interface. As non-limiting examples, spectators maybuild buildings, hide weapons, set difficulty levels, select weather orother environmental factors, or otherwise affect game content and eventsvia UI elements presented on the game spectating interface. In someembodiments, spectators may provide game content to or “gift” particularplayers or teams of players within a game via the game spectatinginterface, for example with objects, boosts, weapons, medicine, healthpoints, strength levels, etc. In some embodiments, spectators canprovide information, for example maps, warnings, or advice, to playersor teams of players in a game via the game spectating interface. In someembodiments, spectators may introduce challenges and difficulties to thegames or players within the games via the game spectating interface, forexample by causing storms or other catastrophes, by increasingdifficulty of game levels or tasks, by taking objects from players, byreducing players' strength, and so on.

In some embodiments the spectating system may store at least part of thegame metadata and broadcast metadata including but not limited tospectator interactions with respective broadcast content as gamespectating data. The game spectating system may provide one or more userinterfaces (UIs), query interfaces, and/or application programminginterfaces (APIs) via which consumers (e.g., game developers, onlinemerchants, broadcasters, etc.) may obtain or view the game spectatingdata, for example for use in analyzing online game usage and performancefor application in game development, advertising, and/or marketing.

Note that the terms “obtain”, “provide”, “download”, “stream”,“provision”, and the like (as used in this document in relation tovarious game-related virtual or physical items including but not limitedto games, game streams, game states, game records or recordings, gamecontent, game characters or gear, game-related merchandise, and so on)may, but do not necessarily, involve purchasing, leasing, subscribingto, or otherwise paying for the respective items.

Example Game Spectating Environments

FIG. 1A is a block diagram that illustrates integrating game systemswith a game spectating system in a game spectating environment,according to some embodiments. A game spectating environment may includea spectating system 100, one or more game systems 120, and multipleclient devices; the client devices may include broadcaster devices 140and spectator devices 160.

Client device (e.g., broadcaster devices 140 and spectator devices 160)may include any of a variety of consumer devices including but notlimited to desktop computer systems, laptop/notebook computer systems,pad/tablet devices, smartphone devices, game consoles, handheld gamingdevices, and wearable devices. Thus, client devices may range frompowerful desktop computers configured as gaming systems down to “thin”mobile devices such as smartphones, pad/tablet devices, and wearabledevices. A client device may implement an operating system (OS) platformthat is compatible with the device. A client device may include, but isnot limited to, input and output components and client software. Theclient software on a particular client device may be tailored to supportthe configuration and capabilities of the particular device type and theOS platform of the device. An example computing device that may be usedas a client device is illustrated in FIG. 33.

A broadcaster device 140 may include, but is not limited to, input andoutput components (including but not limited to input devices andtechnologies such as controllers or joysticks, motion tracking systems,gesture-based input systems, etc.) and game client software and/orhardware for at least one game system 120 via which respective playerscan participate in game sessions currently being executed by the gamesystem(s) 120. A broadcaster device 140 may also include input andoutput components (e.g., video cameras and microphones) and broadcastingclient software and/or hardware for the spectating system 100 via whichrespective players may generate live A/V streams of their online gameplay (broadcasts 142) and other broadcaster input 144 including but notlimited to audio and textual commentary for broadcasting to spectatorsvia the game spectating system 100. A spectator device 160 may include,but is not limited to, input and output components (including but notlimited to input devices and technologies such as controllers orjoysticks, motion tracking systems, gesture-based input systems, etc.)and spectating client software and/or hardware via which respectivespectators may interact with the spectating system 100 to select,receive, and view broadcasts 142 from the broadcasters or playbacks ofpreviously recorded broadcasts, and via which the spectators may providespectator inputs 165 including but not limited to audio or textual chator “crowd noise” for broadcasts 142 and spectator interactions 164 withbroadcast content 126 including but not limited to content generated atleast in part from game metadata 124 received from game system(s) 120 bythe spectating system 100. In some embodiments, spectator inputs 165 mayalso include inputs from input devices and technologies such ascontrollers or joysticks, motion tracking systems, gesture-based inputsystems, and so on.

In some embodiments, spectating system 100 may include one or morecomputing devices, for example one or more server devices, thatimplement game spectating functionality. In some embodiments, spectatingsystem 100 may be a network-based video streaming system or service thatmay allow players to broadcast live streams 142 of their online gameplay to tens, hundreds, thousands or more spectators, while allowing thespectators to select the broadcasts 142 of particular players (alsoreferred to as channels) for viewing. A spectating system 100 maysupport live broadcasts 142 for one, two, or more different game systems120, and may support live streaming of broadcasts 142 from tens,hundreds, or thousands of broadcaster devices 140 to the spectatordevices 160. In some embodiments, a spectating system 100 may record atleast some broadcasts 142 and allow the recorded broadcasts 142 to beplayed back to spectator devices 160 for viewing by spectators. A gamespectating system 100 may support live and recorded broadcasts 142 forone, two, or more different online games 120.

In some embodiments, spectating system 100 may also include or accessother devices, services, or systems including but not limited to storagedevices, systems, or services for storing profile, preferences, andother information for participants (players, broadcasters, and/orspectators), recordings of broadcasts 142, and game spectating dataincluding but not limited to game metadata 124. In some embodiments,spectating system 100 may store recordings of at least some broadcasts142 to a data store, and may allow spectators to select and play backthe recordings via spectating client software on the spectator devices160.

In some embodiments, spectating system 100 may implement one or more UIsand/or one or more APIs to the game spectating system 100 functionality.For example, spectating system 100 may implement a broadcasting UI/API112 that broadcasters may access via broadcaster devices 140 tobroadcast 142 their live game play and other input 144 such as videoinput and audio or textual commentary or chat. As another example,spectating system 100 may implement a spectating UI/API 116 thatspectators may access via spectator devices 150 to select, receive, andview live broadcasts 142 from the broadcasters or playbacks ofpreviously recorded broadcasts 142, and via which the spectators mayprovide spectator input 165 (e.g. audio or textual commentary or chat)for broadcasts 142, and via which the spectators may interact 164 withbroadcast content 126 provided by the spectating system 100. As anotherexample, spectating system 100 may implement a game system API 114 viawhich game system(s) 120 may communicate game metadata 124 to thespectating system 100, and via which the spectating system 100 mayprovide feedback to the game system(s) 120. In some embodiments, atleast some of the game metadata 124, for example game states, may beprovided in response to requests 105 from the spectating system 100.

In some embodiments, a spectating system 100 may support broadcasts oflive and/or recorded digital media content via broadcaster devices 120from sources other than game systems 120. For example, in someembodiments, the spectating system 100 may support live or recordedbroadcasts of streams from sports games, competitions, concerts, andother events including but not limited to live streams from electronicspectator sports (eSports) competitions. eSports (also referred to ascompetitive gaming) generally refers to organized multiplayer video gamecompetitions. For example, video cameras and audio equipment may beinstalled in an arena or other venue in which an event such as a sportsgame or an eSports competition is being held. Video and/or audio feedsfrom the equipment may be input to one or more broadcaster devices 120that may composite and stream the audio/video (A/V) inputs to thespectating system 100. For eSports events, game A/V 121 may be added tothe stream along with the feeds from the cameras and audio equipment.Commentators and/or broadcasters may input their audio, text, and/orvideo content into the stream as well. The live stream may be broadcastto spectator devices 160 by the spectating system 100, and/or may berecorded for rebroadcast. Spectators may view the broadcast on spectatordevices 160, and may also input A/V and/or text input via spectatingsystem clients on their devices 160.

While FIG. 1A shows game systems 120 as separate from spectating system100 and broadcaster device(s) 140, in some embodiments, at least onegame system 120 may be implemented at least in part by or may be acomponent of a spectating system 100. In some embodiments, at least onegame system 120 may be implemented at least in part by or may be acomponent of a broadcaster device 140. In some embodiments, one or morebroadcaster devices 140 may be implemented within spectating system 100.In addition, in some embodiments, a spectating system 100 may beimplemented at least in part by or may be a component of a game system120.

The following is a broad description of an example method for streamingbroadcasts in a game spectating system, and is not intended to belimiting. Typically, a game system 120 may include a game engine thatrenders a 2D or 3D representation of a game universe based on thecurrent state of the universe, generates video and sound, and sends orstreams the video and sound (A/V) output 121 to client devices includingbut not limited to broadcaster device(s) 140 for display. On abroadcaster device 140, the player/broadcaster interacts with the gamesystem 120 and participates in the game executing on the game system 120via player input 122 using game client software on device 140, and usesthe broadcasting UI/API 112 provided by the spectating system 100 toconstruct a live stream (broadcast 142) of the broadcaster's game playfor broadcast. The live stream may include the game A/V 121 receivedfrom the game system 120, and may also include video and audio input ofthe player captured by A/V components (e.g., a video camera andmicrophone) of the device 140 either as a separate stream or embedded inthe game A/V 121 stream. In some embodiments, the player/broadcaster mayalso use broadcasting UI/API 112 to provide text input for a broadcast142, for example text input to a broadcast chat window. FIG. 8 providesa non-limiting example of a broadcaster user interface for a gamespectating system, according to some embodiments.

In some embodiments, the live streams of the broadcasts 142 are sentfrom the broadcaster device(s) 140 to the spectating system 100according to the broadcasting UI/API 112. Video input may be received byspectating system 100 in any of a variety of video formats. Audio inputmay, for example, be received by spectating system 100 as audio tracksin video input, as Voice over IP (VoIP), or according to other networkformats or protocols that support digital audio transmission. On thespectating system 100, the live streams of the broadcasts 142 areprocessed for rebroadcast to spectator devices 160. In some embodiments,at least some of the broadcasts 142 may be recorded and stored forplayback.

On a spectator device 160, a spectator may select a particular broadcast142 or channel for viewing via a spectating UI presented on a spectatordevice 160 according to spectating UI/API 116 provided by the spectatingsystem 100. The spectating system 100 may then stream the selectedbroadcast 142 to the spectator device 140 via spectating UI/API 116 fordisplay. In some embodiments, the spectator may use A/V components ofthe device 160 (e.g., a microphone) to provide audio input (e.g., vocalcommentary, cheers, crowd noise, or vocal chat) for the currentbroadcast 142 being viewed as input 164 via spectating UI/API 116. Thespectator may also provide text input, for example text input to abroadcast chat window provided by spectating UI/API 116. FIGS. 6A, 6 b,7A, 7B, and 9 provide non-limiting examples of spectating userinterfaces that may be used to view broadcasts in a game spectatingenvironment, according to some embodiments.

In at least some embodiments, spectating system 100 may obtain gamemetadata 124 from game system(s) 120 for which broadcasts are beingstreamed, generate broadcast content 126 for respective broadcast 142streams received from broadcast device(s) 140 at least in part from thegame metadata 124, and present the broadcast content 126 with therespective broadcasts 142 to spectators via spectating client interfaceson the spectators' devices 160. In at least some embodiments, the gamemetadata 124 may be received according to a game system API 114presented to the game system(s) 140 by the spectating system 100. Insome embodiments, the game metadata 124 for a given game system 120 mayinclude one or more of, but is not limited to, game state(s) for thegame executing on the game system, indications and descriptions ofevents in the game, and data describing or representing objects,players/characters, locations, levels, and other content or aspects ofthe game. In some embodiments, at least some of the game metadata 124,for example game states, may be provided in response to requests 105from the spectating system 100.

In some embodiments, in addition to obtaining and processing gamemetadata 124 from the game system(s) to generate broadcast content, thespectating system 100 may obtain and analyze various inputs 144 and 164from participants (players, broadcasters, and/or spectators) in the gamespectating environment to detect events in or determine otherinformation about the broadcasts 142 and/or games executing on the gamesystem(s) 120. The events and other information determined fromanalyzing the participant inputs may collectively be referred to asbroadcast metadata. In some embodiments, the spectating system 100 maygenerate broadcast content 126 for respective broadcasts 142 at least inpart from the broadcast metadata, and may present the broadcast content126 with the respective broadcasts 142 to participants including but notlimited to spectators via interfaces on respective spectator devices160. The various participant inputs 144 and 164 may include one or moreof, but are not limited to: audio or voice inputs such as in-game vocalcommunications or broadcast vocal channels; video or image inputs (e.g.,video or images of a participant's facial expressions or eyes); textinput such as in-game or broadcast text chat; biometric inputs from theparticipants; and participant inputs to a broadcast via broadcastingand/or spectating user interfaces (UIs), for example inputs indicatingor voting on in-game events or broadcast events as highlights for thebroadcasts and/or games.

In some embodiments, the generated broadcast content 126 that may bepresented with the respective broadcasts 142 to spectators viaspectating UIs on the spectators' devices may include one or more ofvarious UI elements that may be presented on a spectating UI with thebroadcast 142 video, and/or one or more overlays that may be added tothe broadcast 142 video. At least some of the UI elements may be or mayinclude active UI elements that initiate or perform some action whenselected.

In some embodiments, the broadcast content 126 may be targeted toparticular spectators or groups of spectators, for example according tothe spectators' current selections, profiles, or preferences.

In some embodiments, the spectating system 100 may obtain and processspectator interactions 164 with the broadcast content 126 to affect gamespectating, broadcast 142 processing, and broadcast content 126 in thespectating system 100 in various ways as described herein. In someembodiments, the spectating system 100 may provide game feedback 101 tothe game system(s) 120. The game feedback 101 may be generated at leastin part from the spectator interactions 164 with the broadcast content126. In some embodiments, the game feedback 101 may be providedaccording to a game system API 114 presented to the game system(s) 140by the spectating system 100. The game system(s) 120 may apply the gamefeedback 101 to affect game execution and game play in the game system120 in various ways. In some embodiments, the spectating system 100 mayalso provide broadcast feedback 103 to the broadcast device(s) 140 basedat least in part on the spectator interactions 164 with the broadcastcontent 126. In some embodiments, the broadcast feedback 103 may beprovided to the broadcasters via a broadcasting UI/API 112 presented tothe broadcast devices 140 by the spectating system 100, for example asillustrated in FIG. 9.

In some embodiments, the spectating system 100 may include one or moreinterfaces that can obtain, process, display, and analyze inputs fromother input 167 sources or channels, including but not limited to inputsfrom social media channels such as “tweets” or instant messaging (IMs).In some embodiments, inputs from the other sources 167, such as textinputs to a social media chat channel, may be obtained, processed, andanalyzed to affect broadcast content 126, game feedback 101, and/orbroadcast feedback 103 in various ways as described herein.

FIG. 1B is a block diagram that illustrates a broadcast content servicein a game spectating environment, according to some embodiments. In someembodiments, instead of or in addition to the spectating system 100adding broadcast content 126 to the broadcasts 142 received from thebroadcast device(s) 120, a module, system, or service (referred toherein as a broadcast content service 113) may logically lie between thespectating system 100 and the spectator device(s) 160. Note that thebroadcast content service 113 may be implemented as a module or serviceof the spectating system 100, or may be implemented as a separateservice. In some embodiments, the broadcast content service 113 mayreceive broadcasts 142, game metadata 124, and broadcast metadata 117from the spectating system 100, and may generate and add broadcastcontent 126 based at least in part on the game metadata 124 and/orbroadcast metadata 117. In some embodiments, at least some of the gamemetadata 124, for example game states, may be provided in response torequests 105 from the spectating system 100.

In some embodiments, the broadcast content service 113 may obtain andprocess spectator interactions 164 with the broadcast content 126 toaffect broadcasts 142 and broadcast content 126 presentation andprocessing in the game spectating environment in various ways asdescribed herein. In some embodiments, the broadcast content service 113may generate feedback 119 to the spectating system 100 that thespectating system 100 may apply to affect the game spectatingenvironment. In some embodiments, the spectating system 100 may providegame feedback 101 to the game system(s) 120 based on the feedback 119;the game system(s) 120 may apply game feedback 101 to affect gameexecution and game play in the game system 120. In some embodiments, thespectating system 100 may also provide broadcast feedback 103 to thebroadcast device(s) 140 based at least in part on the feedback 119received from the broadcast content service 113. In some embodiments,the broadcast feedback 103 may be provided to the broadcasters via abroadcasting UI/API 112 presented to the broadcast devices 140 by thespectating system 100, for example as illustrated in FIG. 9.

In some embodiments, at least some components of a game spectatingenvironment as illustrated in FIG. 1A or 1B may be implemented in thecontext of a service provider that provides virtualized resources on aprovider network to clients of the service provider, for example asillustrated in FIG. 32. For example, a spectating system 100 may beimplemented as a spectating service on a provider network as illustratedin FIG. 32. As another example, a broadcast content service 113 may beimplemented as a service on a provider network as illustrated in FIG.32. In some embodiments, one or more game systems 120 may be implementedby game providers on the provider network.

While FIG. 1B shows a broadcast content service 113 that logically liesbetween the spectating system 100 and the spectator device(s) 160, insome embodiments, a broadcast content service 113 may instead logicallylie between a broadcast device 140 and the spectating system 100. Thebroadcast content service 113 may be implemented as a module or serviceof the spectating system 100, or may be implemented as a separateservice. In some embodiments, the broadcast content service 113 mayreceive broadcasts 142, broadcaster input 144, and game metadata 125,and may generate and add content to the broadcast 142. The added contentmay be based at least in part on the game metadata 124. The addedcontent may include, but is not limited to, overlays on the game video.

As illustrated in FIG. 1A or 1B, in some embodiments, game metadata 124may be received by the spectating system 100 from the game system(s) 120according to game system API 114 in a separate channel from the game A/V121 stream. However, in some embodiments, at least some of the gamemetadata 124 may be included as metadata in game A/V 121 content sent tothe broadcast devices 120 by the game system(s) 120, and may be includedas metadata in the broadcast 142 streams sent from the broadcasterdevices 140 to the spectating system 100.

As illustrated in FIG. 1A or 1B, in some embodiments, game metadata 124may be received by the spectating system 100 from the game system(s) 120according to game system API 114. However, in some embodiments,spectating system 100 may obtain or receive game metadata 124 from othersources, including but not limited to broadcast device(s) 140. Inaddition, in some embodiments, a spectator device 160 may obtain orreceive game metadata 124 from one or more sources, including but notlimited to the game system(s) 120 and broadcast device(s) 140.

FIG. 1C is a block diagram that illustrates sources for game metadata ina game spectating environment, according to some embodiments. Aspectating system 100 may stream broadcast(s) 142 from broadcasterdevice(s) 140 to one or more spectator devices 160. The spectatingsystem 100 may receive game metadata 124A from game system 120, asillustrated in FIGS. 1A and 1B. In addition, spectating system 100 mayreceive game metadata 124B from the broadcaster device 140. Gamemetadata 124B may include data specific to the broadcaster/player and/orgame client associated with the broadcaster device 140, for exampleidentity information. In addition, spectating system 100 may request andreceive game metadata 124C from one or more other game metadata sources190. Other game metadata sources 190 may include one or more of, but arenot limited to, game developer systems or third-party systems such asonline merchants, game information sites, and data stores or databasesof game information including but not limited to historical,statistical, and/or descripting information and data for games, gamecontent, players, and/or broadcasters. For example, spectating system100 may request information (game metadata 124C) about a player and/orbroadcaster based on game metadata 124B received from a broadcasterdevice 140. Spectating system 100 may generate broadcast content 126 forthe broadcast 142 based at least in part on game metadata 124A, 124B,and/or 124C. A spectator may interact with the broadcast content 126 onspectator device 126. In response to the interaction, spectating system100 may obtain additional game metadata 124 from one or more of itssources, and provide additional or modified broadcast content 126 to thespectator device 160. However, in some cases, a spectator interactionwith broadcast content 126 may generate a request to one or more of theother game metadata sources 190, which may respond by providing gamemetadata 124D to the spectator device 160, for example to be displayedas additional broadcast content. For example, spectator device 160 mayrequest a source 190 for information (game metadata 124D) about a playeror game content based on descriptive or identity information provided inbroadcast content 126. While not shown in FIG. 1C, in some embodiments aspectator device 160 may instead or also communicate with a game system140 to obtain game metadata 124.

FIG. 1D is a block diagram that illustrates an example game systemarchitecture, according to some embodiments. In some embodiments of agame spectating environment as illustrated in FIGS. 1A and 1B, thespectating system 100 may communicate with a game engine of a gamesystem 120 via the game system API 114. However, in some embodiments,the spectating system 100 may instead communicate with one or more gameservers 125 of the game system 120 to exchange various game system I/O123 as described herein, including but not limited to game metadata 124.The game server(s) 125 may in turn communicate game engine I/O 127 toone, two, or more game engine 129 instances, shown as game engines 129A,129B, . . . , 129 n in FIG. 1D. The game engine 129 instances may beinstantiated on one or more servers of the game system 120, oralternatively at least some of the game engine 129 instances may berunning on the broadcaster devices 140 as illustrated in FIGS. 1A and1B. In some embodiments, the game system I/O 123 received fromspectating system 100 may include at least some data specific toparticular game engines 129, and the server(s) 125 may handledistribution of the data to the target engines 129. In at least someembodiments, the spectating system 100 may instantiate one or moreprocesses on one or more server devices to handle processing data forand handling data from particular game engines 129.

FIG. 2A is a flowchart of a method for determining and presentingbroadcast content in a game spectating environment, according to someembodiments. The method of FIG. 2A may, for example, be implemented by aspectating system 100 as illustrated in FIG. 1A or FIG. 1B.

As indicated at 200 of FIG. 2A, the game spectating system may receivebroadcasts from one or more broadcaster devices. Referring to FIGS. 1Aand 1B, a spectating system may receive broadcasts of players' game playfrom broadcaster devices and stream the broadcasts to spectator devicesfor viewing by respective spectators. A broadcast may include videoshowing game play of a respective broadcaster participating as a playerin a game executing on a game system.

As indicated at 202 of FIG. 2A, the game spectating system may obtaingame metadata from one or more game systems. In at least someembodiments, a game spectating system may obtain game metadata from gamesystems for which broadcasts are being streamed. In at least someembodiments, the game metadata may be received according to anapplication programming interface (API) presented to the game systems bythe spectating system, referred to herein as a game system API. In someembodiments, the game metadata for a given game system may include oneor more of, but is not limited to, game state(s) for the game executingon the game system, indications and descriptions of events in the game,and data describing or representing objects, players/characters,locations, levels, and other content or aspects of the game. The states,events, objects, etc. of a game that may be described in the gamemetadata may collectively be referred to as game-related content.

As indicated at 204 of FIG. 2A, the game spectating system may determineor generate broadcast content for respective broadcasts at least in partfrom the game metadata. The spectating system may use the information inthe game metadata to generate broadcast content that corresponds to thegame-related content represented in the game metadata and thatgraphically and/or textually represents or describes the respectivegame-related content. As indicated at 206 of FIG. 2A, the gamespectating system may stream the broadcasts and associated broadcastcontent to spectator user interfaces on spectator devices forpresentation to spectators. The broadcast content that may be generatedand presented with the respective broadcasts to spectators via spectatorinterfaces on the spectators' devices may include one or more of varioususer interface (UI) elements (e.g., buttons, dialogs, lists, tabs,menus, images, video clips, links, text, panes that include one or moreother UI elements, etc.) that may be presented on a UI with thebroadcast video, and/or one or more game-related overlays (e.g., overlayvideo, text, etc.) that may be added to the broadcast video. Thebroadcast content may include UI elements and/or overlays representingor corresponding to game-related content such as virtual game items orobjects (e.g., digital representations of physical objects) such asin-game gear, clothing, weapons, characters, avatars, powers, and so on,physical items such as physical representations of virtual objects fromwithin the games (e.g., physical swords, action figures, toys, etc.),and game-related physical merchandise such as t-shirts or hats, and mayalso include UI elements and/or overlays representing or describing gameevents and/or game states as indicated in the game metadata.

In some embodiments, in addition to receiving and processing gamemetadata from the game system(s) to generate broadcast content, thespectating system may obtain and analyze various inputs (e.g., audio,video, and/or text inputs) from participants (players, broadcasters,and/or spectators) in the game spectating environment to detect eventsin or determine other information about the broadcasts and/or gamesexecuting on the game systems. The events and other informationdetermined from analyzing the participant inputs may collectively bereferred to as broadcast metadata. The spectating system may generatethe broadcast content for respective broadcasts at least in part fromthe broadcast metadata, and may present the broadcast content with therespective broadcasts to participants including but not limited tospectators via interfaces on respective devices.

As indicated at 208 of FIG. 2A, the game spectating system may receiveand process spectator interactions with the broadcast content from thespectator user interfaces. The spectator interactions with the broadcastcontent may include one or more of, but are not limited to, selecting aUI element, manipulating a UI element (e.g., by scrolling, clicking,sliding, turning, etc.), hovering (e.g., with a cursor) over or near aUI element, inputting to a UI element (e.g., entering text in a textbox), and focusing on one or more UI elements (e.g., as detected via eyetracking technology). In some embodiments, the spectating system mayprocess the spectator interactions with the broadcast content to affectbroadcast presentation in the spectating system and/or game play in thegame system in various ways. In some embodiments, the spectating systemmay provide feedback to the game system(s) based at least in part on thespectator interactions with the broadcast content. In some embodiments,the game feedback may be provided to the games according to a gamesystem API of the spectating system. The game system(s) may apply thegame feedback to affect game execution and game play in the game systemin various ways. In some embodiments, the spectating system may alsoprovide feedback to the broadcast device(s) based at least in part onthe spectator interactions with the broadcast content.

As indicated by the arrow returning from element 208 to element 200, inat least some embodiments, the method of FIG. 2A may be an iterativeprocess in which game metadata for broadcasts is obtained and used togenerate and present broadcast content, and in which interactions withthe broadcast content are received and processed to, for example, affectgame execution and game play.

FIG. 2B is a high-level flowchart of a method for determining andpresenting broadcast content in a game spectating environment, accordingto some embodiments. The method of FIG. 2B may, for example, beimplemented by a broadcast content service 113 as illustrated in FIG.1B.

As indicated at 250 of FIG. 2B, a broadcast content service may receivebroadcast streams, broadcast metadata, and game metadata, for examplefrom a streaming service. As indicated at 252 of FIG. 2B, the broadcastcontent service may determine broadcast content for respectivebroadcasts at least in part from the game metadata and broadcastmetadata. As indicated at 254 of FIG. 2B, the broadcast content servicemay add the broadcast content to the broadcast streams passed to thespectator devices. In some embodiments, instead of or in addition to thespectating system adding broadcast content to the broadcasts receivedfrom the broadcast device(s) as illustrated in FIG. 2A, a broadcastcontent service may logically lie between the spectating system and thespectator device(s). In some embodiments, the broadcast content servicemay receive broadcasts and game metadata from the spectating system, andmay generate broadcast content for the broadcast at least in partaccording to the game metadata, for example as describe in reference toelement 204 of FIG. 1A. In some embodiments, the broadcast contentservice may add the broadcast content as additional content to broadcastcontent generated by the spectating systems. In some embodiments, thebroadcast content service may modify broadcast content generated by thespectating system. In some embodiments, in addition to receiving andprocessing game metadata to generate broadcast content, the broadcastcontent service may obtain broadcast metadata generated by thespectating system, and may generate the broadcast content for respectivebroadcasts at least in part from the broadcast metadata.

As indicated at 256 of FIG. 2B, the broadcast content service mayreceive and process spectator interactions with the broadcast content.In some embodiments, the broadcast content service may obtain andprocess spectator interactions with the broadcast content to affectbroadcasts and broadcast content presentation and processing in the gamespectating environment in various ways as described herein. In someembodiments, the broadcast content service may generate feedback to thespectating system that the spectating system may apply to affect thegame spectating environment. In some embodiments, the spectating systemmay provide game feedback to the game system(s) based on the feedback;the game system(s) 120 may apply the feedback to affect game executionand game play in the game system. In some embodiments, the spectatingsystem may also provide broadcast feedback to the broadcast device(s)based at least in part on the feedback received from the broadcastcontent service.

As indicated by the arrow returning from element 256 to element 250, inat least some embodiments, the method of FIG. 2B may be an iterativeprocess in which a broadcast content service to generates broadcastcontent for broadcasts, and in which interactions with the broadcastcontent are received and processed to, for example, affect gamespectating, game execution, and/or game play.

Determining Events in a Game Spectating Environment

In some embodiments, the spectating system may obtain event dataindicating events or highlights in broadcasts and/or in games executingon the game systems from one or more sources. The event data may beprocessed to determine events from the broadcasts. The determined eventsmay be used to determine broadcast content for the broadcasts, or tootherwise affect broadcasts and/or the games being broadcasts.

In some embodiments, the spectating system may receive indications ofgame events from the game systems as game metadata according to a gamesystem API presented to the game systems by the spectating system. Gameevents may include events that are common across two or more games, andmay also include game-specific events as defined by a respective gamesystem. Examples of game events may include, but are not limited to:particular achievements by particular players or teams of players; levelstarts and completions; beginnings, endings, or other significantmoments of battles, bouts, challenges, or other in-game events; in-gamecharacter entrances, exits, deaths, etc.; acquisitions or loss of items,objects, powers, etc. by in-game characters or players; or in generalany event or moment that may be of interest within a game executing on agame system.

In some embodiments, instead of or in addition to receiving indicationsof game events from the game system(s), the spectating system may obtainand analyze various inputs from participants (players, broadcasters,and/or spectators) in the game spectating environment to detect eventsin the broadcasts and/or games executing on the game systems. Thevarious participant inputs may include one or more of, but are notlimited to: audio or voice inputs such as in-game vocal communicationsor broadcast vocal channels; video or image inputs (e.g., video orimages of a participant's facial expressions or eyes); text input suchas in-game or broadcast text chat; biometric inputs from the players;and participant inputs to a broadcast via spectating user interfaces(UIs), for example inputs indicating or voting on in-game or broadcastevents as highlights for the broadcasts and/or games.

In some embodiments, the participant inputs may be analyzed and mappedto particular events or types of events in an online game that is beingbroadcast on a broadcaster's channel. Examples of events in an onlinegame that may be detected by analyzing participant inputs may include,but are not limited to: particular achievements by particular players orteams of players; level starts and completions; beginnings, endings, orother significant moments of battles, bouts, challenges, or otherin-game events; in-game character entrances, exits, deaths, etc.;acquisitions or loss of items, objects, powers, etc. by in-gamecharacters or players; or in general any event or moment that may be ofinterest within a game executing on a game system. For example, in asports game, crowd (spectator) and/or player audio, text, or otherinputs may be mapped to big plays, such as scoring plays or greatdefensive plays. As another example, in a MOBA game, participant inputsmay be mapped to the start, end, or highlight moments in big battles. Insome embodiments, participant inputs may be analyzed to detect potentialupcoming events in an online game session. For example, in a sportsgame, particular crowd (spectator) and/or player audio patterns, textchat, or other inputs may be mapped to what typically happens prior to aparticular big event, such as crowd silence or chanting before animportant offensive play in a football game, or very low crowd noisebefore a big defensive play in a football game. In some embodiments, theinformation determined from analysis of the participant inputs may alsoindicate locations and times in the game universe for respective events.For example, analysis of spectator and/or broadcaster audio, text, orother inputs may indicate a particular location or area in an onlinegame universe, and a particular time within the game timeline, for anevent in a game session being broadcast by the broadcaster.

In some embodiments, the indications of events received from the gamesystems and/or determined from analyzing the participant inputs may beused to generate broadcast content for respective broadcasts asdescribed herein.

FIG. 5 is a flowchart of a method for determining events in a gamespectating environment, according to some embodiments. The method ofFIG. 5 may, for example, be implemented by a component, module, orservice in a game spectating environment as illustrated in FIGS. 1A and1B. As indicated at 500 of FIG. 5, a spectating system may streambroadcasts of game play received from broadcaster devices to spectatordevices. A broadcast may include video showing game play of a respectivebroadcaster participating as a player in a game executing on a gamesystem. As indicated at 510 of FIG. 5, the spectating system may obtainevent data indicating events in the broadcasts and/or games beingbroadcast. As indicated at 520 of FIG. 5, the spectating system maydetermine events for the broadcasts and/or games according to the eventdata. FIGS. 3A through 3D illustrate example methods and apparatus forobtaining event data and for determining events according to the eventdata. As indicated at 530 of FIG. 5, the spectating system may generatebroadcast content for the broadcasts at least in part according to thedetermined events.

In some embodiments, the event data obtained and processed by thespectating system to detect events may include game events received fromthe game systems. The game events for a given game system may indicategame-specific, in-game events as defined and detected by the respectivegame system. In some embodiments, the game events may be received asgame metadata according to a game system API provided by the spectatingsystem. FIGS. 3A and 3B illustrate receiving and processing game eventsas provided by a game system, according to some embodiments.

In some embodiments, the event data may instead or in addition includeevent tags indicating spectators' and/or broadcasters' inputs to thespectating system marking or tagging interesting or notable events orhighlights in broadcasts. FIGS. 3A and 3C illustrate receiving andprocessing participants' event tagging inputs to a spectating systemthat may be used to determine events in broadcasts, according to someembodiments.

In some embodiments, the event data may instead or in addition includeparticipant (broadcaster and/or spectator) audio and/or text inputs tothe spectating system. The participant audio or text inputs may includebroadcaster inputs such as broadcaster commentary, in-game voice or textchat, and broadcast text chat, and spectator inputs such as spectatorvocal comments, crowd noise, and broadcast text chat. In someembodiments, the spectating system may receive broadcasters' inputs frombroadcaster devices according to a broadcasting UI/API, and may receivespectators' inputs from spectator devices according to a spectatingUI/API. FIGS. 3A and 3D illustrate receiving and processing participantinteractions with a spectating system 100 to determine events orhighlights in broadcasts, according to some embodiments.

In addition to analyzing participant audio and/or textual inputs todetect events, some embodiments may also collect and analyze other datafrom the participants, and may use that analysis alone or in combinationwith the analysis of the participant audio and/or textual inputs todetect events in games or broadcasts. As an example, some embodimentsmay obtain and analyze biometric data (e.g., pulse, heartrate,perspiration, etc.) for participants, for example from wearable devicesthat collect biometrics, and that analysis may be used to determinemetrics that may be used alone or in combination with analysis of otherinputs such as audio and text inputs to determine events in games and/orbroadcasts.

As another example, some embodiments may obtain images of participants'faces (broadcasters, players, commentators and/or spectators) capturedduring game play or broadcast, for example images captured by camerasattached to or integrated with the participants' respective clientdevices. The images may be analyzed, for example using facialrecognition techniques and techniques that detect emotions via analysisof facial expressions, and that analysis may be used alone or incombination with analysis of other inputs such as audio and text inputsto determine events in games and/or broadcasts.

As another example, some embodiments may obtain images of participants'eyes (broadcasters, players, commentators and/or spectators) capturedduring game play or broadcast, for example images captured by camerasattached to or integrated with wearable computing devices such as smartglasses, goggles, optical head-mounted displays, virtual reality (VR)headsets, and the like. The images may be analyzed, for example usingtechniques that detect emotions or other states via tracking andanalysis of eye movements, blinking, dilation, and so on, and thatanalysis may be used alone or in combination with analysis of otherinputs such as audio and text inputs to determine events in games and/orbroadcasts.

FIG. 3A illustrates event processing in a game spectating system,according to some embodiments. In some embodiments, a spectating system400 may include one or more computing devices, for example one or moreserver devices, that implement one or more components or modules of thespectating system 400 and that provide one or more APIs to thespectating system 400 functionality. In some embodiments, the spectatingsystem 400 may include, but is not limited to, an event detection 470component or module that determines or predicts events in broadcasts442, and a broadcast content generation 480 component or module that maygenerate broadcast content 426 from the determined events or eventpredictions. Spectating system 400 may also include or access otherdevices including but not limited to storage devices, services, orsystems (shown as store 477) for storing data and information, includingbut not limited to various data 478 used in analyzing participant inputsand other event data sources to detect events, and event information 479describing the detected events.

In some embodiments, event detection 470 component may include a gameevent processing 472 module that processes game events 434 to determinegame-specified events in broadcasts 442, a participant event tagprocessing 474 component that processes event tags 466 to determineparticipant-specified events in broadcasts 442, and a participant inputprocessing 476 component that processes participant inputs 465 todetermine events in broadcasts 442 based on participants' inputs (audio,video, text, speech, social media, etc.) during the broadcasts 442. Insome embodiments, participant inputs 465 may also include inputs frominput devices and technologies such as controllers or joysticks, motiontracking systems, gesture-based input systems, and so on that can beanalyzed and used to determine events in respective broadcasts 442.

In some embodiments, in addition to determining events in broadcasts442, event detection 470 component may process the various inputs togenerate information that anticipates or predicts potential upcomingevents in game sessions or broadcasts. For example, in a sports game,audio, textual, or other input may be analyzed to generate predictionsof upcoming big plays, or in a MOBA or MMOG audio, textual, or otherinput may be analyzed to generate predictions of upcoming fights orbattles. In some embodiments, this information predicting events inbroadcasts may be presented to the spectators as broadcast content, forexample so that the spectators can view the predicted events inreal-time, if desired.

In some embodiments, the spectating system 400 may include or provide agame system API 414 via which game systems or other entities may providegame events 434 to the spectating system 400. The game events 434 mayindicate game-specific events as defined and detected by respective gamesystems 420. In some embodiments, the spectating system 400 may includeor provide a spectating UI/API 416 that presents an interface tospectators on respective spectator devices 460. The spectators mayinteract with the spectating system 400 via inputs 456 to the spectatingUI/API 416, for example to interact with broadcast content 426 generatedby broadcast content generation 480 module from the events or eventpredictions generated by event detection 470 component and presented tothe spectators on respective spectator devices 460 via the spectatingUI/API 416.

FIGS. 3B through 3D further illustrate the components, modules, andoperations of an example spectating system 400 as shown in FIG. 3A.

FIG. 3B illustrates game event processing to determine events in a gamespectating system, according to some embodiments. In some embodiments,event data that may be received and processed by a spectating system 400to determine events in broadcasts 442 may include game events 434generated by game systems 420. The game events 434 for a given gamesystem 420 may, for example, indicate game-specific, in-game highlightsas defined and detected by the respective game system 420. In someembodiments, a spectating system 400 may include a game event processing472 module that processes game events 434 to determine game-specifiedevents for broadcasts 442.

In some embodiments, the spectating system 400 may include or provide agame system API 414 via which game systems 420 can provide game events434 to the spectating system 400. A game event 434 may indicate agame-defined interesting or notable event or highlight in game play on arespective game system 420. FIG. 3B illustrates a non-limiting exampleformat for game events 434, according to some embodiments. In thisexample, a game event 434 may be a record that may include one or moreof, but is not limited to:

-   -   A timestamp (date/time) that indicates “real world time” for the        game event.    -   A game ID that may be used to identify the game system 420 that        generated the event 434.    -   A game session ID that may be used to identify a particular game        session executed by the game system 420.    -   A game session timestamp (date/time) that indicates time within        the game universe/on the game session timeline (“game time”) for        the game event.    -   An event type for the game event. An event type may be common        across all game systems 420 or across some game systems 420        (e.g., all games within a genre), or may be specific to/defined        by a particular game system 420.    -   A duration for the event. The duration may be indicated in real        time, in game time, or in both.    -   A location within the game universe or game world for the event.    -   Other event information. For example, information identifying        players or teams of players who are involved in the event,        broadcasters who are involved in the event, a summary        description of the event, a rating for the event (e.g., event        significance on a scale from 1 to 10), or in general any        information that may be relevant to an in-game event.

In some embodiments, the game event processing 472 module may receiveand process the game events 434 to determine game-specified events orevent predictions for broadcasts 442. In some embodiments, the gameevent processing 472 module may map at least some of the game events 434to particular broadcasts 442. In some embodiments, for example, abroadcast 442 may include metadata indicating a particular game system420, game session, and broadcaster/player for the broadcast 442, and thegame event processing 472 module may map at least some of the gameevents 434 to particular broadcasts 442 according to the game ID, gamesession ID, timestamp, and other event information fields of the gameevent 434 records. Once a game event 434 is mapped to a broadcast 442,the information within the event 434 record may be used to generatebroadcast content 426A for the broadcast 442.

In some embodiments, in addition to indicating events in games, gameevents 434 may be provided that anticipate or predict potential upcomingevents in online game sessions. For example, in a sports game, a gameevent 434 may be provided prior to an important offensive play, or in aMOBA or MMOG a game event 434 may be provided that indicates an upcomingfight or battle. In some embodiments, this information predicting oranticipating events in games may be presented to the spectators asbroadcast content 426A so that the spectators can view broadcasts of thepredicted events in real-time, if desired.

FIG. 3C illustrates participant event tag processing to determine eventsin a game spectating system, according to some embodiments. In someembodiments, event data that may be received and processed by aspectating system 400 to determine events from broadcasts 442 mayinclude event tags 466 generated by broadcasters and/or spectators viarespective devices 440 and 460. The event tags 466 for a given broadcast442 may indicate interesting or notable events in the broadcast 442 asidentified by the broadcaster and/or spectators of the broadcast 442. Insome embodiments, a spectating system 400 may include a participantevent tag processing 474 module that processes event tags 466 todetermine participant-specified events from broadcasts 442.

In some embodiments, the spectating system 400 may provide broadcastingand spectating UI/APIs via which broadcasters and/or spectators canprovide event tags 466 to the spectating system 400. An event tag 466may indicate a participant-defined interesting or notable event orhighlight in a respective broadcast 442. FIG. 3C illustrates anon-limiting example format for event tags 466, according to someembodiments. In this example, an event tag 466 may be a record that mayinclude one or more of, but is not limited to:

-   -   A timestamp (date/time) for the event tag.    -   A broadcast ID that may be used to identify the broadcast 442        for which this tag 466 event was generated.    -   A participant ID that may be used to identify a particular        broadcaster and/or spectator who generated this tag 466 event.    -   An event type for the tag 466. As an example, in some        embodiments tag event types may include “start” tags and “stop”        tags that indicate the start of an interesting or notable event        and the end of the respective event; thus, two tags (a start and        stop tag) would define an event in the respective broadcast 442        as indicated by the respective participant.

In some embodiments, event tags 466 may include other information abouta participant-specified event. For example, in some embodiments, eventtags 466 may indicate a duration for the respective event. In someembodiments, event tags 466 may indicate a location within the gameuniverse or game world for the event. In some embodiments, event tags466 may include one or more of information identifying players or teamsof players who are involved in the event, information identifyingbroadcasters who are involved in the event, a summary description of theevent, or a rating for the event (e.g., event significance on a scalefrom 1 to 10).

In some embodiments, spectators and/or broadcasters may vote on eventsin broadcast 442 streams or game sessions via respective UIs, forexample to determine if an event is to be considered a significant ornotable event or highlight for the broadcast 442. For example,spectators and/or broadcasters may be prompted to respond with an up ordown vote for event(s) in broadcast 442 streams or game sessions, andthe event tags 466 may include voting information (e.g. up/down voteinformation) for the events in broadcast 442 streams or game sessions.

In some embodiments, the participant event tag processing 474 module mayreceive and process the event tags 466 to determine broadcast content426 for broadcasts 442. In some embodiments, the participant event tagprocessing 474 module may map at least some of the event tags 466 toparticular broadcasts 442 according to the broadcast ID. Once the eventtags 466 are mapped to broadcasts 442, the event tags 466 may be used ingenerating broadcast content 426B for the broadcasts 442. For example,in some embodiments, the event tags 466 may be used to identify andextract highlight segments from the broadcasts 442, and the highlightsegments may be provided as broadcast content 426B.

In some embodiments, to identify events in a broadcast 442 from theevent tags 466 for the broadcast 442, the participant event tagprocessing 474 module may analyze the event tags 466 according toinformation in the tags 466 to determine how many and/or whichparticipants tagged a given event in a broadcast 442 or game session.For example, in some embodiments, the participant event tag processing474 module may determine that a tagged event is a significant or notableevent in a broadcast 442 if at least a threshold number or percentage ofspectators tagged the event as and/or voted for the event as a notableevent. As another example, a broadcaster's tag 466 may automaticallymake a respective event a notable event, or alternatively abroadcaster's tagged event may be put up for vote by the spectators todetermine if the event is to be considered a notable event. In someembodiments, participant's opinions on events as expressed through thetags 466 may be weighted; for example, a given spectator may be ahighly-rated spectator or designated commentator, and the spectator'stags 466 may automatically make a respective event a notable event, orthe spectator's tags 466 may be given more weight than those of otherspectators when tagging or voting on events as potential notable events.

In some embodiments, in addition to indicating notable events inbroadcasts, event tags 466 may be provided that anticipate or predictpotential upcoming events in broadcasts. For example, in a sports game,spectators and/or broadcasters may generate event tags 466 inanticipation of an important offensive play, or in a MOBA or MMOG a gameevent tags 466 may be generated that indicate a potential upcoming fightor battle. In some embodiments, this information predicting oranticipating events in games may be presented to the spectators asbroadcast content 426B so that the spectators can view broadcasts of thepredicted events in real-time, if desired.

FIG. 3D illustrates processing participant inputs to determine events ina game spectating system, according to some embodiments. In someembodiments, the event data that may be received and processed by aspectating system 400 to determine events in broadcasts 442 may includeparticipant (broadcaster and/or spectator) audio and/or textual inputsto the spectating system 400 (e.g., broadcaster commentary, in-gamevoice or text chat, broadcast text chat, spectator vocal comments, crowdnoise, etc.). In some embodiments, the event data may instead or inaddition include video of participants (broadcasters and/or spectators)captured during broadcasts 442. In some embodiments, a spectating system400 may include a participant input processing 476 component thatprocesses participant inputs 465 to determine events from broadcasts 442based on participants' various inputs and interactions (e.g., audio,video, text, speech, social media, etc.) during the broadcasts 442.

In some embodiments, participant input processing 476 component mayinclude or have access to one or more analysis modules 492 that analyzeand process participants' various inputs (e.g., audio, video, text,speech, etc.) to detect events 494 in broadcasts 442 based on the inputsrelated to the broadcasts 442. In some embodiments, analysis modules 492may include, but are not limited to, a video analysis 492A module, anaudio analysis 492B module, a text analysis 492C module, and a contentanalysis 492D module.

In at least some embodiments, generally, an analysis module 492 mayperform analysis on its input signal(s) and/or other input data todetermine one or more metrics from the inputs, and then may match thedetermined metrics to known patterns. The patterns may then be mapped toparticular types of events that may be output as detected events 494. Insome embodiments, in addition to detecting events 494 that indicateinteresting or notable events or highlights in broadcasts 442, ananalysis module 492 may detect events 494 that anticipate or predictpotential upcoming events in game sessions or broadcasts. For example,in a sports game, events 494 may be detected that anticipate upcomingbig plays, or in a MOBA or MMOG events 494 may be detected thatanticipate upcoming fights or battles.

In some embodiments, participant input processing 476 component may alsoinclude or have access to one or more sources of analysis data 499 thatmay be used in analyzing the participants' interactions to detect events494. The analysis data 499 may include data that is specific to gamesand game systems (e.g., mappings of particular audio, text, and/orspeech to specific events in games), and may also include data that isspecific to particular participants or groups of participants (e.g.,audio or speech patterns, facial metrics, etc.).

In some embodiments, participant input processing 476 component may alsoinclude a detected event processing 496 module that processes the events494 detected by the analysis modules 492, for example to determinebroadcast content 426C for the broadcasts 442. In some embodiments, theanalysis modules 492 may provide detected events 494 to the detectedevent processing 496 module, for example according to an API for themodule 496. The detected events 494 may indicate potentially interestingor notable events in the broadcasts 442 as determined from analysis ofthe participants' various inputs 465 (audio, video, chat, social media,etc.). FIG. 3D illustrates a non-limiting example format for detectedevents 494, according to some embodiments. In this example, a detectedevent 494 may be a record that may include one or more of, but is notlimited to:

-   -   At least one timestamp (date/time) for the detected event 494.        The timestamp(s) may include real-time (broadcast) timestamps        and/or “game time” timestamps.    -   A broadcast ID that may be used to identify the broadcast 442        for which this event 494 was detected.    -   A participant ID that may be used to identify a particular        broadcaster and/or spectator related to this detected event 494.    -   An event type for the detected event 494. An event type may an        in-game event type; a game event may be common or generic across        all game systems 420 or across some game systems 420 (e.g., all        games within a genre), or may be specific to/defined by a        particular game system 420.

In some embodiments, detected event 494 records may include otherinformation about an event. For example, in some embodiments, detectedevent 494 records may indicate a duration for the respective event. Insome embodiments, detected event 494 records may indicate a locationwithin the game universe or game world for the event. In someembodiments, detected event 494 records may include one or more ofinformation identifying players or teams of players who are involved inthe event, information identifying broadcasters and/or spectators whoare involved in the event, a summary description of the event, or arating for the event (e.g., event significance on a scale from 1 to 10).In some embodiments, a detected event 494 record may include aconfidence level for the event that may indicate how confident therespective analysis module 492 is that the analyzed input datacorrelates to the indicated event 494.

In some embodiments, participant input processing 476 component mayinclude or have access to a video analysis 492A module. In someembodiments, participant inputs 465 may include video of participants(broadcasters and/or spectators) captured during a broadcast 442, forexample by video cameras attached to or integrated with theparticipants' respective devices 440 or 460. The participant video maybe analyzed, for example using facial recognition techniques andtechniques that detect emotions via analysis of facial expressions, todetermine metrics that may be used in identifying events in respectivebroadcasts 442. For example, a broadcaster's facial expressions maycaptured by a live video feed included in a broadcast 442, and the videomay be analyzed to detect emotions of the broadcaster during game play.Various emotions such as surprise, fear, happiness, intenseconcentration, and so on may be detected that may be correlated toin-game events (victories, defeats, startling in-game events, etc.) orto broadcast events (e.g., the broadcaster spilled a drink on hiskeyboard, fell out of his chair, etc.). As another example, someembodiments may obtain images of participants' eyes (broadcasters,players, commentators and/or spectators) captured during game play orbroadcasts 442, for example images captured by cameras attached to orintegrated with wearable computing devices such as smart glasses,goggles, optical head-mounted displays, virtual reality (VR) headsets,and the like. The images may be analyzed, for example using techniquesthat detect emotions or other states via tracking and analysis of eyemovements, blinking, dilation, and so on, and that analysis may be usedalone or in combination with analysis of other inputs such as audioinputs to determine states of participants that may be correlated toin-game events or to broadcast events.

In some embodiments, participant input processing 476 component mayinclude or have access to an audio analysis 492B module. Online gamesand game spectating systems may support audio input/output andcommunications for game players and for game spectators. For example, aplayer in an online game may communicate game play commands,suggestions, comments, strategy, chat, or other information to otherplayers on their team within the game via audio input to a respectivecomputing device. As another example, a broadcaster may provide vocalcommentary to spectators via an audio channel of a game spectatingsystem. As another example, spectators in a game spectating system mayprovide cheers, comment, chat, or other audio input for broadcasts viaaudio input channels to the game spectating system. Aggregatedparticipants' (player and/or spectator) audio signals may be used toprovide background chatter or “crowd noise” for an online game orbroadcast. The participants' audio input signals may be captured byaudiovisual (A/V) input components on the participants' respectiveclient devices, digitized, and transmitted over a network to the onlinegame or spectating system. At the online game or spectating system, theparticipants' audio signals may be aggregated, processed, andtransmitted to the players' and/or spectators' respective devices foroutput as game or broadcast audio.

In some embodiments, audio analysis 492B module may process and analyzethe various audio inputs from players, broadcasters, and/or spectatorsto detect events 494. In some embodiments, the audio analysis 492Bmodule may perform signal analysis, for example time- andfrequency-domain analysis, on the audio signals to determine one or moreaudio signal metrics from the audio signals. The metrics may, forexample, include one or more of amplitude, pitch, duration, andfrequency metrics, and in general any relevant metric that can beextracted from an audio or voice signal. The audio signal metrics may beanalyzed, for example by comparing the metrics to known or learned audiopatterns for individual participants or groups of participants, todetermine information about the participants and/or the game session.

In some embodiments, the audio signals may be individually analyzed todetermine metrics for each audio input, and the metrics may then benormalized, aggregated, and analyzed to determine information aboutgroups of participants (players and/or spectators). In some embodiments,instead of or in addition to separately analyzing the audio signals andthen aggregating the metrics for further analysis, the audio signals maybe aggregated or combined and analyzed collectively to generate metricsfor and information about groups of participants.

In some embodiments, participant information obtained for or with theaudio input signals may be used when analyzing the audio input signalsto determine information about the spectators and/or players. Forexample, the participant information may indicate affiliations or teampreferences for spectators of a sports game based on the spectators'profile information. The spectator audio signals for a game may besegmented into two or more groups according to the metadata, for exampleinto groups of fans of two opposing teams in a sports game such asfootball according to the spectators' indicated team affiliations, andanalyzed separately according to the groups to determine group-specificinformation about the current game session or broadcast. For example,the group-specific information may indicate which group of spectatorsare currently cheering or booing, which group is the loudest and/orquietest, and so on. In some embodiments, player/broadcaster audiosignals may also be segmented into groups (e.g., opposing teams)according to player profile information for player group analysis.

In some embodiments, the information determined from the analysis of theparticipant audio inputs may, for example, indicate an emotional stateor states (e.g., excitement, stress, fear, shock, surprise, amusement,etc.) of individual participants (players and/or spectators) based onthe analysis of the individual participants' vocalizations or othersounds in the respective audio signals. In some embodiments, the audioanalysis information may instead or also indicate a state or states fora group or crowd (e.g., excitement, stress, approval, disapproval, etc.)based on an analysis of the combined audio signal metrics for two ormore participants (players and/or spectators). In some embodiments, theinformation may also indicate a level for a determined state, forexample an indication of how excited a crowd of spectators appears to bebased on an analysis of aggregated spectator audio input.

In some embodiments, the information determined from the analysis of theparticipant audio inputs may be used to detect particular events 494 inan online game session or broadcast. For example, in some embodiments,at least some of the audio patterns to which the audio signal metricsare matched may be mapped to particular types of events in a respectiveonline game. For example, in a sports game, particular crowd (spectator)and/or player audio patterns may be mapped to big plays, such as scoringplays or great defensive plays. In some embodiments, the information mayanticipate or predict a potential upcoming event in an online gamesession or broadcast. For example, in a sports game, particular crowd(spectator) and/or player audio patterns may be mapped to what typicallyhappens prior to a particular big event, such as crowd silence orchanting before an important offensive play in a football game, or verylow crowd noise before a big defensive play in a football game. In someembodiments, the information may also indicate locations and timeswithin the game universe for particular events to which the analyzedaudio signals are mapped. For example, analysis of aggregated spectatoror player audio signals and correlated metadata may indicate aparticular location or area in the online game universe, and aparticular time within the game timeline.

In some embodiments, audio analysis 492B module may identify and extractwords, phrases, or other content from the input audio associated with abroadcast 442. In some embodiments, audio analysis 492B module mayanalyze the content to detect events 494 in the broadcast 442. Forexample, the audio analysis 492B module may try to match keywords orphrases that it identifies in the audio stream(s) of a broadcast 442 tokeywords or phrases associated with events in game play in general, tokeywords or phrases associated with particular events in the genre orgame that the broadcaster is participating in as a player, and/or tokeywords or phrases associated with particular participants (e.g.,broadcasters). In some embodiments, audio analysis 492B module mayprovide the extracted content to another analysis module 492, forexample to a content analysis 492D module, which performs analysis ofthe extracted content to detect events 494 for the broadcast 442.

In some embodiments, participant input processing 476 component mayinclude or have access to a text analysis 492C module. Instead of or inaddition to audio input, online games and game spectating systems maysupport text input/output and communications for game players and forgame spectators. For example, players in online games may communicategame play commands, suggestions, comments, strategy, or otherinformation to other players on their team within the game via textinput to an in-game chat window. As another example, broadcasters andspectators may participate in chat windows associated with particularbroadcasts 442 in a game spectating system 400. In some embodiments,text analysis 492C module may parse the text from one or more sources ina broadcast 442 (e.g., an in-game chat window and a broadcast chatwindow) to identify and extract words, phrases, or other content fromthe input text. In some embodiments, the spectating system 100 mayinstead or also include one or more interfaces that can obtain, process,and analyze text inputs from other input sources or channels, includingbut not limited to inputs from social media channels such as “tweets” orinstant messaging (IMs). In some embodiments, text analysis 492C modulemay analyze the extracted text content to detect events 494. Forexample, the text analysis 492C module may try to match keywords orphrases that it identifies from the content of chat windows associatedwith a broadcast 442 to keywords or phrases associated with events ingame play in general, to keywords or phrases associated with particularevents in the genre or game that the broadcaster is participating in asa player, and/or to keywords or phrases associated with particularparticipants (e.g., broadcasters). In some embodiments, text analysis492C module may provide the extracted content to another analysis module492, for example a content analysis 492D module, which performs analysisof the extracted content to detect events 494.

In some embodiments, participant input processing 476 component mayinclude or have access to a content analysis 492D module. Contentanalysis module 492D may receive content (e.g., words and/or phrases)extracted from audio/voice and/or text chat inputs to the broadcasts442, and may analyze the received content to detect events 494. Forexample, the content analysis 492D module may try to match keywords orphrases from the extracted content to keywords or phrases associatedwith events in game play in general, to keywords or phrases associatedwith particular events in the game or genre of game that the broadcasteris participating in as a player, and/or to keywords or phrasesassociated with particular participants (e.g., broadcasters). In someembodiments, content analysis 492D module may access one or moreanalysis data 499 sources to search data sets of keywords or phrasesassociated with particular genres, games, broadcasters, and so on; thedata sets may map the keys to particular events or types of events ofinterest that may be considered as significant or notable events orhighlights in broadcasts.

FIG. 4 illustrates processing participant inputs to determinebroadcast-related information in a game spectating system, according tosome embodiments. In some embodiments, instead of or in addition todetecting and processing events 494, participant input processing 476component may process one or more of the participant inputs 465 togenerate other broadcast-related analysis information 427 that may beapplied in the game spectating environment in various ways as describedherein, for example in determining rewards for participants asillustrated in FIG. 16, to generate broadcast content 426 for display toa game spectating interface, or to generate inputs to the game systemengine via a game system API of the spectating system to influence gameexecution and game play as illustrated in FIGS. 19 through 26. In someembodiments, participant inputs 465 may include, but are not limited to,audio, video, and text inputs to the spectating system via a spectatingUI 416. In some embodiments, participant inputs 465 also include inputsfrom input devices and technologies coupled to or included in spectatordevices such as controllers or joysticks, motion tracking systems,gesture-based input systems, and so on that can be analyzed and used togenerate broadcast-related analysis information 427. In someembodiments, the spectating system 400 may include one or moreinterfaces that can obtain and process inputs from other input sourcesor channels, including but not limited to inputs from social media suchas “tweets” or instant messaging (IMs), and the inputs to the otherinput channels may be similarly analyzed to generate broadcast-relatedanalysis information 427. The following provides several examples ofdetecting and applying broadcast-related analysis information 427 withina game spectating system. However, note that these examples are notintended to be limiting.

As an example of detecting and applying broadcast-related analysisinformation 427 within a game spectating system, broadcast-relatedanalysis information 427 may be determined for spectators of one or morebroadcasts of a particular online game and may be leveraged to identifyparticular players, locations, areas, or regions within a game world ofthe online game being broadcast for which activity is “hot”, for exampleas illustrated in FIG. 9. A map or portion of a map of the online gameworld may be displayed on at least some spectator devices, for exampleby a spectating UI as illustrated in FIG. 9, and players, teams, areas,regions, or locations that have been identified as active within thegame according to analysis of the spectator inputs 495 may be marked orhighlighted on the map. In some embodiments, instead of or in additionto a map of active or interesting players and/or locations, textualinformation may be displayed indicating particularly players and/orlocations of interest as determined by analysis of the spectator inputs495. In some embodiments, audio announcements or sounds may be used tocall attention to particular players and/or locations. In someembodiments, the information about players and/or locations of interestwithin a game world may also be provided to the game players and/orbroadcasters, for example via feedback of the broadcast-related analysisinformation to the broadcaster devices. In some embodiments, theinformation about players and/or locations of interest within a gameworld may be used to generate feedback or inputs to the game system, forexample as illustrated in FIGS. 19 through 26.

As another example of detecting and applying broadcast-related analysisinformation 427 within a game spectating system, the analysisinformation 427 may indicate an emotion or emotional state (e.g.,stress, excitement, anger, sadness, happiness, frustration, etc.) forone or more of the broadcasters. The analysis information 427 may beused to generate inputs to the game system engine via the game systemAPI of the spectating system. The players' avatars or online charactersin the game universe may be visually or otherwise affected in responseto the inputs.

As another example of detecting and applying broadcast-related analysisinformation 427 within a game spectating system, the analysisinformation 427 for spectators may be leveraged to affect the gamecharacters and game play of the broadcasters. For example, analysis ofthe audio and/or text chat inputs 465 for spectators viewing aparticular player's broadcast may indicate that the player/broadcasterhas spectator backing or is a spectator favorite when compared to otherplayers in the game. This information may be used to generate inputs tothe game system engine via the game system API of the spectating systemthat positively affect or reward the player's avatar or character withinthe game, for example by boosting player health, providing supplies,providing points, or in various other ways. In some embodiments, teamsof players corresponding to broadcasters may be identified, and theteams may be affected by inputs to the game system engine based on theanalysis of spectator audio and/or text chat inputs 465 forbroadcaster(s) that are on the team.

As another example of detecting and applying broadcast-related analysisinformation 427 within a game spectating system, aggregated analysisinformation 427 for spectators of broadcasts of online games may beleveraged to identify particular currently active channels or broadcastsof interest. In some embodiments, the channels of interest may beindicated on at least some of the spectator devices, for example byhighlighting the channel(s) on a spectating UI, or adding the channelsto a “recommended” or “hot” list for currently active channels. In someembodiments, the information about channels of interest may also beprovided to the broadcasters, for example via feedback of the analysisinformation 427 to the broadcaster devices indicating comparativechannel popularity or ranking according to analysis of crowd noise orchat for the respective channels. In some embodiments, the analysisinformation 427 indicating channels or broadcasts of interest may beused to generate inputs to the game system engine via the game systemAPI of the spectating system rewarding the respective broadcasters, foreexample by providing boosts, gear, or other in-game benefits to thebroadcasters' in-game characters or avatars.

As another example of detecting and applying broadcast-related analysisinformation 427 within a game spectating system, aggregated analysisinformation 427 for spectators of broadcasts of online games may beleveraged to identify particular broadcasters of interest. In someembodiments, the broadcasters of interest may be indicated on at leastsome of the spectator devices, for example by highlighting thebroadcasters and/or the channel(s) associated with the identifiedbroadcasters on the spectating UI, or adding the broadcaster(s) to a“recommended” or “hot” list for broadcasters. In some embodiments, theinformation about broadcasters may also be provided to the broadcasters,for example via feedback of the analysis information 427 to thebroadcaster devices indicating the broadcasters' respective currentpopularity according to analysis of crowd noise or chat on thebroadcasters' respective channels. In some embodiments, the analysisinformation 427 indicating broadcasters' popularity may be used togenerate inputs to the game system engine via the game system API of thespectating system, for example inputs rewarding popular broadcasters byproviding boosts, gear, or other in-game benefits to the broadcasters'in-game characters or avatars.

As another example of detecting and applying broadcast-related analysisinformation 427 within a game spectating system, aggregated analysisinformation 427 for spectators of broadcasts of online games may beleveraged to identify particular online games of interest, for examplegames for which activity is currently “hot” or interesting according tothe “crowd noise” or chat in broadcasts of the current game. In someembodiments, the games of interest may then be indicated on at leastsome of the spectator devices, for example by highlighting the games onthe spectating UI. In some embodiments, the analysis information 427indicating games of interest may be used to generate inputs to the gamesystems via the game system API of the spectating system, for exampleinputs to a particular game system indicating that the game is currentlyhot in the spectating environment. The game system may use this input invarious ways, for example by rewarding at least some of the players byproviding boosts, gear, or other in-game benefits to the players'in-game characters or avatars.

As another example of detecting and applying broadcast-related analysisinformation 427 within a game spectating system, the audio and/or textchat inputs 465 for a broadcast or broadcasts may be analyzed to detectaffiliations or preferences of spectators. The detected affiliations orpreferences may be used to segment the spectators into two or moregroups (e.g., fans of particular players or teams). For example,spectators may be detected to be fans of a particular player or teambased at least in part on their audio and/or text chat inputs 465(cheering, booing, loud, quiet, etc.) at particular times or in responseto particular events in a game or broadcast. As another example,spectators may be detected to be fans of a particular player or teambased at least in part on particular keywords, phrases, or chantsrecognized in their audio and/or text chat inputs 465 to thebroadcast(s). In some embodiments, a spectator's detected affiliationsor preferences may be added to their profile information. In someembodiments, the spectator's profile information may be modified overtime based upon additional analysis of their audio or other inputs. Insome embodiments, the analysis information 427 indicating spectatoraffiliations or preferences may be used to generate inputs to the gamesystems via the game system API of the spectating system, for exampleinputs to a particular game system indicating how many spectators arefans of two or more teams in the current game. The game system may usethis input in various ways, for example by rewarding at least some ofthe players by providing boosts, gear, or other in-game benefits to theplayers' in-game characters or avatars based on their fan base, or byproviding visual and/or audio indications of the spectators'affiliations, for example as illustrated in FIG. 22.

As another example of detecting and applying broadcast-related analysisinformation 427 within a game spectating system, the audio and/or textchat inputs 465 for a broadcast may be segmented into two or more groups(e.g., fans of particular players or teams), for example based onprofile information for the respective spectators or analysis of thespectators' audio and/or text chat inputs 465 to detect affiliations orpreferences, and analyzed separately according to the groups todetermine group-specific information about games in the spectatingsystem. For example, the group-specific information may indicate whichgroup of spectators are currently cheering or booing, which group is theloudest and/or quietest, and so on. The group-specific information maybe used to generate inputs to the game systems via the game system APIof the spectating system, for example inputs to a particular game systemindicating two or more spectator groups, and the current levels ofexcitement in the groups supporting opposing teams. The game system mayuse this input in various ways, for example to provide visual and/oraudio feedback to the players and/or spectators in the game spectatingsystem, for example visual and/or audio feedback indicating currentlevels of excitement in the groups supporting opposing teams. Forexample, virtual representations of spectators on one side of a stadiumor arena in an online sports game may be made to stand up, wave flags,or otherwise visually or audibly respond when spectators who aredetermined to be fans of a particular team and/or player are cheering orbooing loudly, for example as illustrated in FIG. 22.

As another example of detecting and applying broadcast-related analysisinformation 427 within a game spectating system, spectator audio outputmay be provided by the game spectating system via audio channel(s) ofthe broadcast to the spectators, particular groups of the spectators(e.g., to particular fans), and/or to the broadcaster(s) in response tothe analysis information 427. For example, when spectators who aredetermined to be fans of a particular team and/or player are determinedto be cheering or booing loudly based on analysis of the spectators'audio and/or text chat inputs 465, spectator audio output of the cheersor boos may be provided by the game spectating system to at least someof the spectators (e.g., to the fans of a particular team) and/orplayers via audio channel(s) of the broadcast. As another example,analysis of the spectators' audio and/or text chat inputs 465 may detectparticularly interesting inputs from individual spectators or groups ofspectators (e.g., a particular spectator or group cheering or chantingloudly, heckling a player, etc.), and spectator audio output of theinteresting audio inputs may be provided by the game spectating systemvia an audio channel of the broadcast. In some embodiments, thespectator audio output may be generated from or as a mix of thespectator audio input(s). In some embodiments, the spectator audiooutput may be “canned”, pre-recorded, or synthesized sounds or soundtracks (e.g., crowd cheers or boos) that are played in response to theanalysis information 427. In some embodiments, the analysis information427 indicating different groups' current responses to the game such ascheering, enthusiasm, or disappointment may be used to generate inputsto the game systems via the game system API of the spectating system,for example inputs to a particular game system indicating how differentgroups of spectators are currently responding. The game system may usethis input in various ways, for example by rewarding at least some ofthe players by providing boosts, gear, or other in-game benefits to theplayers' in-game characters or avatars based on their fan base's currentlevel of enthusiasm, or by providing visual and/or audio indications ofthe groups' current responses, for example as illustrated in FIG. 22.

As another example of detecting and applying broadcast-related analysisinformation 427 within a game spectating system, the spectators' audioand/or text chat inputs 465 for a game or broadcast may be analyzed todetect currently interesting spectators, for example particularspectators who are cheering or chanting loudly or heckling a player, orspectators who are particularly happy, angry, or excited. Thespectator's interesting audio input may be provided to otherparticipants (spectators and/or broadcasters) by the game spectatingsystem via an audio channel of the broadcast. In addition, in someembodiments, video or images of spectators who are identified ascurrently interesting based upon their audio input may be provided tothe spectators and/or broadcasters, for example in a picture-on-picturewindow overlaid on the broadcast video. The video may be video of theinteresting spectator(s) captured by video cameras in their spectatingenvironment or simulated video or images of avatars representing thespectator(s) and simulating their detected emotional state.

FIG. 6A provides a non-limiting example of a spectating user interfacefor a game spectating system, according to some embodiments. Aspectating UI 602 may, for example be presented as a Web page of a gamespectating system website via a Web browser, as an interface to a gamespectating Web application or mobile application, or as an interface toother network-based game spectating applications. A spectating UI 602may include one or more panes or regions including one or more of, butnot limited to, controls 610, current broadcast pane 630, games 650,channels 660, and video on demand 670. Controls 610 may include one ormore UI elements for navigating or otherwise interacting with the gamespectating system. Games 650 may display UI elements corresponding toone or more online games 652 supported by or currently available throughthe game spectating system. This example shows a racing 652A game, afootball 652B game, and a space explorer 652C game. Channels 660 maydisplay UI elements corresponding to one or more currently active (orupcoming) broadcasts or channels 662, for example channels 662corresponding to broadcasters for a currently selected game 652. In thisexample, the space explorer 652C game is selected, and channels 662shows three broadcasters 662A, 662B, and 662C for the currently selectedgame 652C. Video on demand 670 may, for example, display UI elementscorresponding to one or more videos 672, including but not limited topreviously recorded broadcasts and/or highlight reels that are availablefor viewing. In this example, video on demand 670 shows examplepre-recorded videos 672A-672C and a highlight reel 672D for thecurrently selected game 652C. While not shown, in some embodiments, aspectating UI 602 may include a recommendations pane that may display UIelements corresponding to one or more of recommended games 652, channels662 (broadcasters), and recorded videos 672 including but not limited tohighlight reels.

In some embodiments, content of recommendations, channels 660 and/orvideo on demand 670 may be determined at least in part according to acurrently selected game 652. For example, in some embodiments, aspectator may select a game 652C to view the currently active channels662 for the selected game 652C, and to view recordings of broadcasts forthe selected game 652. While not shown, in some embodiments, the UI 602may allow the spectator to select particular broadcasters, and thecontent of recommendations, channels 660 and/or video on demand 670 maybe determined at least in part according to the currently selectedbroadcaster.

Current broadcast pane 630 may include a video player 632 with A/Vcontrols 633 that displays the video stream (shown as broadcast 634) fora currently selected live broadcast or channel 662 (in this example,channel 662A), or a currently selected video 672 being played to therespective spectator device. The broadcast 634 may include game playvideo, for example shown from the broadcaster/player's viewpoint orperspective or from a bird's eye view, and a window 635 showing a liveview of the broadcaster/player, in this example broadcaster/player A.The video player 632 typically also plays an audio stream that mayinclude one or more of the in-game audio, broadcaster audio, and theaudio commentary or “crowd noise” from the spectators. In someembodiments, the audio may also include commentary or play-by-play callsfrom a commentator. In some embodiments, current broadcast pane 630 mayalso include a chat 636 pane in which broadcaster and/or spectator textchat may be displayed. In some embodiments, current broadcast pane 630may also include a highlight 635 pane that displays highlights, forexample a highlight from a currently active or selected highlight reelor a highlight from the current broadcast. In some embodiments, currentbroadcast pane 630 may also include one or more UI elements via which aspectator can control the highlight 635 display.

In some embodiments, current broadcast pane 630 may include or provideUI elements that may display broadcast content based at least in part ongame metadata for the game being broadcast 634. At least some of the UIelements may be or may include active UI elements that initiate orperform some action when selected. In this example, game play in thespace explorer 652C game is currently being broadcast, so the broadcastcontent includes content related to the space explorer 652C game.

As shown in this example, in some embodiments, current broadcast pane630 may include a broadcast content 640 pane via which spectators mayview information about different categories of game content. Forexample, broadcast content 640 pane may include tabs via whichspectators may view information about players, items, places, events, orother categories of game content as described in the game metadata. Fora category of content, the spectators may select and view informationabout particular instances of the content, for example particularplayers. For a particular instance of content, the spectators may viewfurther details.

As shown in this example, information about player A in the spaceexplorer 652C game being broadcast is shown. The player information mayinclude information such as the player's name and affiliations (e.g.,team), the player's skills or powers, the player's skill or experiencelevels, the player's ratings, accomplishments, and other statistics, theplayer's gear such as tools, outfit/clothes, and weapons, or any otherinformation that a game may keep or track about players. In thisexample, the viewer has interacted with the broadcast content 640 toview the player's gear, and has further selected to view the player'sweapons. In the displayed list of weapons that player A currentlypossesses, the viewer has selected Disrupter Pistol to view descriptiveinformation about this particular item of the player's in-game gear. Thedescriptive information may, for example, include image(s) (“DP9000”)and a textual description of the item. For example, for a weapon, thedescriptive information may indicate the range, capacity, andeffectiveness of the weapon. In some embodiments, the descriptiveinformation may include usage information for a particular item or typeof item. For example, a list of all the players who use an item such asa particular sword or other weapon may be provided. In some embodiments,the descriptive information may include statistical data about thein-game content. For example, for a weapon or other piece of in-gamegear, popularity or ratings based on player usage and/or participantvoting may be provided.

In some embodiments, the broadcast content 640 pane may include UIelements via which the viewer can order, purchase, or otherwise obtaingame-related content. The game-related content may include virtual gameitems or objects (e.g., digital representations of physical objects)such as in-game gear, clothing, weapons, characters, avatars, powers,and so on, that may be acquired for use within the games, physical itemssuch as physical representations of virtual objects from within thegames (e.g., physical representations of in-game weapons such as swords,action figures, toys, etc.), and/or game-related physical merchandisesuch as t-shirts or hats. In some embodiments, the spectating system mayprovide, or may provide access to, a “print on demand” service whereby3D printing technology may be used to print physical objects based oninput designs or specifications of game-related objects or items (e.g.,in-game characters, weapons, vehicles, monsters, etc.). The designs orspecifications for the objects may be obtained from the game systems inthe game metadata, or may be otherwise obtained. For example, in thebroadcast content 640 pane shown in FIG. 6A, the viewer may select the“GET IT!” UI element to obtain a virtual DP9000 pistol for use withinthe Space Explorers game and/or to order or purchase a physical model ofthe DP9000 pistol from a game system provider, online merchant,manufacturer, or other entity.

In some embodiments, broadcast content based at least in part on gamemetadata for the game being broadcast 634 may be overlaid, blended, orcomposited into the video stream content to be displayed in broadcast634. This broadcast content may be referred to herein as overlaycontent. In some embodiments, overlay content may be added to the videostream by a spectating service 100 as illustrated in FIGS. 1A and 1B. Insome embodiments, overlay content may instead or in addition be added tothe video stream by a broadcast content service 113 between spectatingservice 100 and at least some of the spectator devices 160. The overlaycontent may include textual and/or graphical content. As a non-limitingexample, text tags or captions may be added to objects or scenes in thevideo stream. For example, as shown in FIG. 6A, name tags (shown as A,B, C, D, and E in FIG. 6A) may be added to characters in the videostream so that spectators may identify the players in the game. Asanother example, objects or characters of interest may be identifiedfrom the game metadata and/or broadcast metadata, and those objects orcharacters may be visually indicated using overlay content in the videostream. For example, the game metadata and/or broadcast metadata mayindicate an emotion or emotional state (e.g., stress, excitement, anger,sadness, happiness, frustration, etc.) for one or more of the players,and the players' avatars or online characters as displayed in the gameuniverse may be visually modified, for example using colors, to indicatethe respective players' emotions or emotional states. For example, asshown in FIG. 6A, character E in broadcast 634 has been highlightedusing overlay content that changes the visual appearance of thecharacter in the video stream.

As another example of using overlay content, in some embodiments,objects or regions in broadcast 634 may be made interactive usingoverlays. For example, in some embodiments, at least some objectsdisplayed in broadcast 634 may be interactive so that a spectator mayselect the objects in broadcast 634 to open an overlay window 638 thatprovides information about the object. For example, in FIG. 6A, thespectator has used a cursor to select the spaceship and open a window638 that shows the ship's name, type, and capabilities. In someembodiments, the overlay content on broadcast 634 may include UIelements via which the viewer can order, purchase, or otherwise obtaingame-related content. For example, in FIG. 6A, the viewer may select a“GET IT!” UI element in overlay window 638 to obtain a virtual HarpoonXL ship for use within the “Space Explorers” game and/or to order orpurchase a physical model of the Harpoon XL ship from a merchant ormanufacturer.

FIG. 6B provides another non-limiting example of a spectating UI for agame spectating system, according to some embodiments. In someembodiments, a spectating UI 652 may include or provide UI elements thatmay display broadcast content based at least in part on metadata for thegame being broadcast 634 (in this example, the Space Explorers game),for example game metadata received from a respective game system orother source as illustrated in FIG. 1C. At least some of the UI elementsmay be or may include active UI elements that initiate or perform someaction when selected. FIG. 6B provides examples of spectating userinterface elements and methods for exploring a game being broadcast, ora replay of a previously recorded broadcast, that are based at least inpart on the game metadata. A spectating UI 652 may, for example bepresented as a Web page of a game spectating system website via a Webbrowser, as an interface to a game spectating Web application or mobileapplication, or as an interface to other network-based game spectatingapplications. A spectating UI 652 may include panes or regions includingone or more of, but not limited to, controls 610, a video player 632with A/V controls 633, broadcast content 640, world map 696, broadcasts690, and a chat window 636.

Controls 610 may include one or more UI elements for navigating orotherwise interacting with the game spectating system. Video player 632may display the video stream (shown as broadcast 634) for a currentlyselected broadcast 692 (in this example, broadcast 692A) or for a replayof a previously selected broadcast. The broadcast 634 may include gameplay video, for example shown from the broadcaster/player's viewpoint orperspective or from a bird's eye view, and a window 635 showing a liveview of the broadcaster/player, in this example broadcaster/player A.Video player 632 typically also plays an audio stream that may includeone or more of the in-game audio, broadcaster audio, and the audiocommentary or “crowd noise” from the spectators. In some embodiments,the audio may also include commentary or play-by-play calls from acommentator. In some embodiments, spectating UI 652 may also include achat 636 pane in which broadcaster and/or spectator text chat may bedisplayed. Broadcasts 690 pane may display UI elements corresponding toone or more players in the current game that are broadcasting for thegame, or that broadcasted for a game being replayed. In this example,player A's broadcast 692A is currently selected. In some embodiments,the viewer or spectator can switch to a different player's live orpreviously recorded broadcast 692 by selecting the respective UI elementin broadcasts 690.

As shown in this example, in some embodiments, spectating UI 652 mayinclude a broadcast content 640 pane via which spectators may viewinformation about different categories of game content. For example,broadcast content 640 pane may include tabs via which spectators mayview information about players, items, places, events, or othercategories of game content as described in the game metadata. For acategory of content, the spectators may select and view informationabout particular instances of the content, for example particularplayers or game-related content or items. For a particular instance ofcontent, the spectators may obtain or view further details.

As shown in this example, a tab displaying information about items inthe game being broadcast is shown as selected in broadcast content 640.The tab pane may include control or navigation UI elements such as ascroll bar. In this example, the displayed list of items includes adisrupter pistol (“DP9000”) and a laser rifle (“LR20C”). In someembodiments, for at least some of the displayed items, a list of playerswho possess or use the respective item may be provided. In someembodiments, the spectator can select a player in the list to switch tothe player's live or previously recorded broadcast 692. Once at theother player's broadcast 692, the viewer can watch the player use theitem, view statistics for the player, request more information about orthe player's opinion of or advice for using the item, obtain, copy, orclone the player's gear, and so on. While this example describesswitching to other players' broadcasts from the items tab of the inbroadcast content 640 pane, in some embodiments viewers can switchbroadcasts by selecting players from lists on the other panes. Forexample, the “places” pane and “events” pane may provide lists ofplayers at or associated with various places and events in the game, andthe viewer may select a player from the list to switch to the selectedplayer's broadcast.

In some embodiments, a player in the list for an item may not be abroadcaster. In this case, selecting the player from the list mayprovide the option to switch to a broadcast of another player who may beassociated with the first player, for example another player on the sameteam or at the same general location in the game being broadcast orreplayed.

As shown in FIG. 6B, UI elements may also be provided in the broadcastcontent 640 items tab via which information about the respective itemsmay be viewed or obtained. In some embodiments, the information mayinclude statistical data about the item. For example, for a weapon orother piece of in-game gear, popularity or ratings based on player usageand/or participant voting may be provided. In some embodiments, thebroadcast content 640 pane may include UI elements via which the viewercan order, purchase, or otherwise obtain the respective item. Forexample, in the broadcast content 640 pane shown in FIG. 6B, the viewermay select a respective “GET IT!” UI element to obtain a virtual DP9000pistol for use within the Space Explorers game and/or to order orpurchase a physical model of the DP9000 pistol from a game systemprovider, online merchant, manufacturer, or other entity.

In some embodiments, the spectating system may detect the locations forvarious game content in the game universe, including the location of theplayers who are broadcasters for the game, at least in part from thegame metadata received from various sources as illustrated in FIG. 1C.In some embodiments, a world map 696 or portion of a map of the gameworld may be displayed on UI 652. In some embodiments, the locations ofplayers, teams, areas, events, regions, or locations may be marked orhighlighted or otherwise visually indicated on the map 696. In someembodiments, the locations of players who are broadcasters for the gamemay be highlighted or otherwise visually indicated on a world map 696.For example as illustrated in FIG. 6B, players A, B, G, and F are shownas broadcasters. In some embodiments, the viewer or spectator can switchto a different player's live or previously recorded broadcast 692 byselecting the respective broadcaster/player in map 696. In someembodiments, analysis of game metadata and/or broadcast metadata asdescribed herein (for example, analysis of text chat 636 and/or audiochat or crowd noise) may identify active or exciting broadcasts, and thebroadcaster/player's location indicator on the map 696 may behighlighted. For example, in FIG. 6B, broadcaster/player A's broadcastis the broadcast being viewed in video player 632, and that player'sindicator on map 696 is indicated by a circle. However,broadcaster/player E's broadcast is drawing a lot of attention fromspectators, and so that player's indicator on the map 696 is highlightedwith a star. The viewer may select broadcaster/player E on the map 696to switch to that broadcast.

FIGS. 7A and 7B provide non-limiting examples of a spectating userinterface for a game spectating system, according to some embodiments. Aspectating UI 702 may, for example be presented as a Web page of a gamespectating system website via a Web browser, as an interface to a gamespectating Web application or mobile application, or as an interface toother network-based game spectating applications. A spectating UI 702may include one or more panes or regions including one or more of, butnot limited to, controls 710, a video player 732 with A/V controls 733,and a broadcast content pane 740 via which a spectator may view andinteract with broadcast content based at least in part on game metadatafor the game being broadcast 734. Controls 710 may include one or moreUI elements for navigating or otherwise interacting with the gamespectating system. Video player 732 displays the video stream (shown asbroadcast 734) for a live broadcast or channel or for a replay of apreviously recorded broadcast. In some embodiments, spectating UI 702may also include a chat 736 pane in which broadcaster and/or spectatortext chat may be displayed, for example spectator chat discussing gameinformation and content such as in-game gear displayed in broadcastcontent pane 740.

Broadcast content pane 740 may, for example, include a game information744 pane that displays information for the game being broadcast based atleast in part on the game metadata received from the respective gamesystem, and a game content details 746 pane via which the viewer mayexplore, view, and interact with detailed information about game content(objects, gear, characters, players, locations, events, etc.) based atleast in part on the game metadata for the game being broadcast 734.

As shown in FIG. 7A, in some embodiments, game content details 746 panemay include UI elements that the spectator may interact with to viewvarious game content and to obtain more information about the gamecontent. For example, as shown in FIG. 7A, game content details 746 paneincludes a “Select a player” UI element that the spectator may select toview a list of players; the spectator may select one of the players toview additional information about the player. For example, in FIG. 7A,the viewer has selected “Player E” from the list to view the itemscurrently in player E's gear set in game content details 746 pane(DP9000 disruptor pistol, LR20C laser rifle, Harpoon XL ship, helmet,survival pack, etc.). Note that the players in the list may be, but arenot necessarily, players in the current game being broadcast orreplayed.

In some embodiments, the spectator system 100 and/or a broadcast contentservice 113 may add content to or change content of the broadcastcontent pane 740 in response to events detected in the broadcast 734.The events may, for example, be detected by one or more methods asillustrated in FIGS. 3A through 3D. For example, information about gamecontent, game events, players, and so on may be added to or changed inthe broadcast content pane 740 based at least in part on the gamemetadata. For example, in FIG. 7A, information about a player or othergame content may be added to or changed in game content details 746 panein response to an event in the broadcast, for example an event involvingPlayer E such as Player E's first appearance in the game or in thecurrent scene.

As shown in FIG. 7A, in some embodiments, broadcast content may includeoverlays 738 on the broadcast 734. In some embodiments, the spectatorsystem 100 and/or a broadcast content service 113 may add overlays 738to the broadcast 734 in response to events detected in the broadcast734. The events may, for example, be detected by one or more methods asillustrated in FIGS. 3A through 3D. An overlay window 738 may provideadditional information about game content, game events, players, and soon based at least in part on the game metadata obtained from the gamesystem. For example, as shown in FIG. 7A, an overlay window 738A hasbeen added to broadcast 734 in response to an event involving Player E,such as Player E's first appearance in the game or in the current scene.The example overlay window 738A shows the player's attributes (name,team, level, skills, etc.), statistics (ratings, accomplishments, kills,experience, etc.) and gear (weapons, clothing, tools, vehicles, etc.).The content of overlay windows 738 may be obtained from the spectatingsystem, game system, game developer, game servers, broadcaster devices,third parties such as online merchants, or in general from any source asillustrated in FIG. 1C. In addition to overlay windows 738 that showadditional information about game content, game events, and so on,overlay windows 738 may include images, video clips, advertisements,titles or labels, links to external websites, or in general any type ofcontent. In some embodiments, an overlay window 738 may include activeUI elements that the viewer can interact with to display additionalinformation about the selected game content in broadcast content 740pane. For example, in FIG. 7A, the viewer may select a “see gear” UIelement in overlay window 738A to view the items currently in player E'sgear set in game content details 746 pane.

As shown in FIG. 7B, in some embodiments, broadcast 734 may includeoverlay content that allows the viewer to interact with the broadcast734, for example to open an overlay window 738B that provides additionalinformation about the content based at least in part on the gamemetadata obtained from the game system. For example, as shown in FIG.7B, the spectating UI 702 is displayed on a touch-enabled device, andthe spectator has used touch gestures to select Player E and open anoverlay window 738B that shows the player's attributes (name, team,level, skills, etc.), statistics (ratings, accomplishments, kills,experience, etc.) and gear (weapons, clothing, tools, vehicles, etc.).In some embodiments, the overlay window 738B may include active UIelements that the viewer can interact with to display additionalinformation about the selected game content in broadcast content 740pane. For example, in FIG. 7B, the viewer has selected a “see gear” UIelement in overlay window 738B to view the items currently in player E'sgear set in game content details 746 pane (DP9000 disruptor pistol,LR20C laser rifle, Harpoon XL ship, helmet, survival pack, etc.).

In some embodiments, at least some of the UI elements displayed inbroadcast content 740 pane may be interactive elements that, forexample, allow the viewer to get additional information about the gameor game content based at least in part on the game metadata obtainedfrom the game system, or to order, purchase, or otherwise obtain thegame or game content. For example, in some embodiments, the viewer mayinteract with the UI elements displayed in game content details 746 paneto obtain additional details about the items, to obtain the virtual itemfor use within the “Space Explorers” game and/or to order or purchase aphysical model of the virtual item from a merchant or manufacturer. Asanother example, the viewer may interact with the UI elements displayedin game information 744 pane to get more information about the game, orto obtain or purchase the game, from the game system provider or fromsome other source.

FIG. 8 provides a non-limiting example of a broadcaster user interfacefor a game spectating system, according to some embodiments. Abroadcaster's device 800 may implement a game and broadcasting UI 802,and may include or be coupled to an A/V device 808 (e.g., a video camerawith microphone) to collect broadcaster/player 820 audio and video inputand speakers 804 to output game audio (including spectator audio and/orcrowd noise). The broadcaster's device 800 may also include or becoupled to a keyboard 809 or other input device(s) via which thebroadcaster/player 820 may enter text input such as player chat orbroadcast chat. In some embodiments, the broadcaster's device 800 mayalso include or be coupled to input devices and technologies such ascontrollers or joysticks, motion tracking systems, gesture-based inputsystems, and so on.

In some embodiments, broadcasting UI 802 may include a game play window810 that displays a current view of the game universe for thebroadcaster/player 820. Note that the broadcaster's view of the gameuniverse as shown in window 810 may be included in the broadcast andshown to spectators, for example as shown in FIG. 9. In someembodiments, UI 802 may also include game controls 814 via which thebroadcaster/player 820 may interact with the game system. In someembodiments, UI 802 may include in-game chat 814 via which thebroadcaster/player 820 may communicate to other players in the game viatext. In some embodiments, UI 802 may also include broadcast controls818 via which the broadcaster/player 820 may interact with thespectating system to control the broadcast. In some embodiments, UI 802may include broadcast chat 818 via which the broadcaster/player 820 andspectators may communicate via text.

In some embodiments, a world map 812 or portion of a map of the onlinegame world may be displayed on UI 802, for example as a window within oroverlaying the game play window 810. Broadcaster/player A's teamlocation is shown by the oval marked with an “A”. In some embodiments,players, teams, areas, regions, or locations corresponding to current orpotential events that have been identified by one or more of the methodsas described herein may be marked or highlighted or otherwise visuallyindicated on the map 812. Broadcaster/player A and his team may, in somecases, take action based upon the visual indications of events displayedon the map 812.

As shown in FIGS. 1A and 1B, in some embodiments, the spectating systemmay provide broadcast feedback to the broadcast device 800 based atleast in part on spectator interactions with the broadcast contentgenerated from the game metadata and/or broadcast metadata. In someembodiments, at least some of the broadcast feedback may be provided tothe broadcaster 820 via a broadcasting feedback 817 pane or window ofbroadcasting UI 802.

FIG. 9 provides another non-limiting example of a spectating userinterface for a game spectating system, according to some embodiments. Aspectator's device 900 may implement a spectating UI 902, and mayinclude a microphone 906 to collect spectator audio input and speakers904 to output game audio (including spectator audio and/or crowd noise,broadcaster audio commentary, etc.). The spectator's device 900 may alsoinclude or be coupled to a keyboard 909 or other input device(s) viawhich the spectator 960 may enter text input such as broadcast chat 918.In some embodiments, the spectator's device 900 may also include or becoupled to input devices and technologies such as controllers orjoysticks, motion tracking systems, gesture-based input systems, and soon.

In some embodiments, UI 902 may include a game spectating window 910that displays a current view of the game universe from thebroadcaster/player's perspective. In this example, spectator 960 iscurrently viewing a group of players B, C and D from the perspective ofplayer A (the broadcaster) in spectating window 910. In someembodiments, UI 902 may also include spectator controls 916 via whichthe spectator 960 may interact with the spectating system to control thebroadcast, select other broadcasts, and so on. In some embodiments, UI902 may include a broadcast chat 918 window via which the spectator 960may communicate with the broadcaster/player and other spectators viatext.

In some embodiments, UI 902 may include a window 914 showing a live viewof the broadcaster/player, in this example broadcaster/player A. Window914 may be displayed, for example, as a window within or overlaying thegame spectating window 910. In some embodiments, a world map 912 orportion of a map of the online game world may be displayed on UI 902,for example as a window within or overlaying the game spectating window910. Broadcaster/player A's team location is shown by the oval markedwith an “A”.

In some embodiments, UI 902 may include a broadcast content 940 pane orregion in which broadcast content based at least in part on gamemetadata received from a respective game system may be displayed to andaccessed by the spectator 960. The broadcast content 940 pane may, forexample, show information about the game, game players, game objects oritems, game events, and so on as provided by the game system in the gamemetadata. In some embodiments, UI 902 may instead or also include anoverlay window 938 that shows broadcast content based at least in parton game metadata received from a respective game system. Overlay window938 may be displayed, for example, as a window within or overlaying thegame spectating window 910. In this example, overlay window 938 showsdetails (gear, health, statistics, etc.) about the currently selectedplayer B.

In some embodiments, players, teams, areas, regions, or locationscorresponding to current or potential events that have been identifiedby one or more of the methods as described herein may be marked orhighlighted or otherwise visually indicated on the world map 912. Forexample, the oval marked “H!” may indicate a location for a past,current, or upcoming event. In some embodiments, the spectator 960 mayselect an indicated event from the world map 912 to view or replay theevent in game spectating window 910 or in another window displayed on UI902.

Game Merchandising Interface

In some embodiments, the spectating system may leverage the gamemetadata provided by the game system(s) to provide a virtual storefrontfor game-related content on the spectating user interface (UI) via whichspectators may view, select, and order, purchase, or otherwise obtaingame-related content. The game-related content may include virtual ordigital game-related items or objects (e.g., digital representations ofphysical objects) such as in-game gear, clothing, weapons, characters,avatars, powers, and so on, that may be acquired for use within thegames, physical items or objects such as physical representations ofvirtual objects from within the games (e.g., physical swords, actionfigures, toys, etc.), and/or game-related physical merchandise such ast-shirts or hats.

In some embodiments, the spectating system provider may provide at leastsome of the game-related content to the requesting spectators. In someembodiments, the virtual storefront of the spectating system mayinterface with one or more entities, including but not limited to thegame systems or game system providers and online merchants, to providerequested game-related content to spectators. In some embodiments, thespectating system may provide, or may provide access to, a “print ondemand” service whereby 3D printing technology may be used to printphysical objects based on input designs or specifications ofgame-related objects or items (e.g., in-game characters, weapons,vehicles, monsters, etc.). The designs or specifications for the objectsmay be obtained from the game systems in the game metadata, or may beotherwise obtained.

In some embodiments, the virtual storefront may provide UI elementswhereby spectators can view information about the in-game content, forexample historical information and/or statistics on whichcharacters/players use an item or object, how they use it, the item'shistory or success, and so on. The spectating system may provide textand/or voice chat channels via which the spectators and broadcasters maydiscuss the game-related items or objects available via the virtualstorefront. In some embodiments, a broadcaster may select or specifyparticular game-related items or objects that are to be provided via thevirtual storefront UI on the broadcaster's channel.

FIG. 10 illustrates an example virtual storefront module in a gamespectating system 100 that provides game-related merchandise tospectators via a spectating interface, according to some embodiments. Agame spectating system 100 such as the game spectating system 100 asillustrated in and described for FIGS. 1A and 1B may implement one ormore components or modules 1010 that may present broadcast content 126to spectators via a spectating UI 116 on respective spectator devices160. The broadcast content 126 may be determined at least in part fromgame metadata 124 received from the game system(s) 120 according to agame system API 114 provided by the spectating system 100. In someembodiments, the broadcast content 126 may be determined at least inpart from game-related data acquired from one or more other sources suchas online merchants. The spectators may view, explore, discuss, select,and order, purchase, or otherwise obtain game-related content via thespectating UI 116 and interactions with the broadcast content 126presented on the spectator devices 160 according to the spectating UI116. The storefront module(s) 1010 may obtain and process spectatorinteractions 164 with the broadcast content 126 presented on thespectator devices 160 to generate and send requests 1022 to order,purchase, or otherwise obtain selected virtual and/or physicalgame-related merchandise to merchandise sources such as the game system120 providers (requests 1022A), to storage 1090 systems or services thatstore game-related content 1091 (requests 1022C), and/or to othersources 1070 of virtual 1023 and/or physical 1076 items or objects(requests 1022B) such as online merchants or 3D print-on-demandservices, and may facilitate provisioning or delivery of the requestedvirtual items 1023A, 1023B, or 1023C as virtual items 1023D to therespective spectator devices 160, or physical 1076 game-relatedmerchandise to the respective spectators. In some embodiments, virtualitems 1023 may include game content (e.g., game characters, gear,avatars, game states, etc.) that is downloaded or otherwise provided togame clients on respective spectator devices 160.

In some embodiments, a broadcaster may select or specify 1003 particulargame-related items or objects that are to be offered by the storefrontmodule(s) 1010 via broadcast content 126 on the respective broadcast 142channel. The storefront module(s) 1010 may obtain and process spectatorinteractions 164 with the broadcaster-specified content 126 presented onthe spectator devices 160 to generate and send requests 1022 to order,purchase, or otherwise obtain selected game-related merchandise torespective merchandise sources 120, 1090, and/or 1070. In someembodiments, the spectating system 100 may also provide broadcastfeedback 103 to the broadcast device(s) 140 based at least in part onthe spectator interactions 164 with the broadcast content 126. In someembodiments, the broadcast feedback 103 may be provided to thebroadcasters via a broadcasting UI/API 112 presented to the broadcastdevices 140 by the spectating system 100, for example as illustrated inFIG. 9.

FIG. 11 is a flowchart of a method for providing game-relatedmerchandise via a game spectating system, according to some embodiments.The method of FIG. 11 may, for example, be implemented by a spectatingsystem 100 as illustrated in FIG. 1A, 1B, or 10. As indicated at 1100 ofFIG. 11, a spectating system may stream broadcasts of game play tospectator devices. A broadcast may include video showing game play of arespective broadcaster participating as a player in a game executing ona game system.

As indicated at 1110 of FIG. 11, the spectating system may provide agame merchandising interface on the spectator devices via whichspectators may view, select, and order, purchase, or otherwise obtaingame-related content. FIG. 12 provides a non-limiting example of a gamemerchandising interface or virtual storefront for a game spectatingsystem. In some embodiments, a broadcaster may select or specifyparticular game-related content to be provided via the gamemerchandising interface for the broadcaster's channel.

As indicated at 1120 of FIG. 11, the spectating system may providebroadcast content corresponding to game-related content or merchandisevia the game merchandising interface. The game-related content mayinclude virtual or digital game-related items or objects (such asin-game gear, clothing, weapons, characters, avatars, powers, and so on,that may be acquired for use within the games, physical items or objectssuch as physical representations of virtual objects from within thegames (e.g., physical representations of in-game weapons such as swords,game-related action figures, toys, etc.), and/or other game-relatedphysical merchandise such as posters, books, t-shirts or hats. Thebroadcast content may be based at least in part on game metadatareceived from the game system according to a game system API provided bythe spectating system. In some embodiments, the game metadata mayinclude data describing or representing at least some of thegame-related content that may be used in generating the broadcastcontent. In some embodiments, the spectating system may acquire and usedescriptive data for game-related content from one or more other sourcessuch as online merchants.

The broadcast content presented via the game merchandising interface mayinclude one or more UI elements (e.g., buttons, dialogs, lists, tabs,menus, images, video clips, links, text, panes, etc.) presented on thegame merchandising interface. In some embodiments, the broadcast contentmay also include one or more overlays on the broadcast video. In someembodiments, the broadcast content may include UI elements via which theviewer can order, purchase, or otherwise obtain the game-related contentvia the game merchandising interface. In some embodiments, the broadcastcontent may include or provide access to descriptive information aboutthe game-related content, for example descriptions, images, and/or videoclips of the game-related content. In some embodiments, the broadestcontent may include or provide access to historical information orstatistics for the game-related content, for example statistics on whichcharacters/players use an item or object, how they use it, the item'shistory or success, and so on. In some embodiments, the spectatingsystem may provide text and/or voice chat channels via which thespectators and broadcasters may discuss the game-related contentpresented via the game merchandising interface.

As indicated at 1130 of FIG. 11, the spectating system may receive inputfrom a spectator device requesting or purchasing game-relatedmerchandise selected via the game merchandising interface of thespectating system. As indicated at 1140 of FIG. 11, the spectatingsystem may facilitate provisioning or delivery of the requestedgame-related merchandise to the respective spectator. In someembodiments, the broadcast content may include UI elements with whichthe viewers/spectators can interact and via which the viewer can select,order, purchase, or otherwise obtain the game-related content via thegame merchandising interface. The spectating system may obtain andprocess the spectator interactions with the broadcast content presentedon the spectator devices via the game merchandising interface togenerate and send requests for selected game-related content to variousvirtual game-related merchandise and/or physical game-relatedmerchandise sources, and may facilitate provisioning or delivery of therequested virtual or physical game-related merchandise to the respectivespectators. In some embodiments, the spectating system provider mayprovide at least some of the game-related content to the requestingspectators. In some embodiments, the spectating system may interfacewith one or more entities, including but not limited to game systems orgame system providers and online merchants, to provide at least some ofthe requested game-related content to spectators. In some embodiments,the spectating system may provide, or may provide access to, a “print ondemand” service whereby 3D printing technology may be used to printphysical objects based on input designs or specifications ofgame-related objects or items (e.g., in-game characters, weapons,vehicles, monsters, etc.). The designs or specifications for the objectsmay be obtained from the game systems in the game metadata, or may beotherwise obtained.

In some embodiments, purchases of game-related merchandise via the gamemerchandising interface of the spectating system may be reflected in thespectating UI so that other spectators can see what's been purchased,and who purchased it. In some embodiments, the purchases may be reportedback to the broadcaster(s) via the broadcaster client interface asbroadcaster feedback. A broadcaster may thus see what is being purchasedduring a broadcaster. The broadcaster may, for example, do giveaways ofvirtual and/or physical merchandise as rewards based on how muchmerchandise is sold through the broadcaster's channel. Similarly, thepurchases may be reported back to game systems, game developers, orthird parties such as online merchants via respective feedback channels.Element 1237 of FIG. 12 shows an example “sales info” pane 1237 thatmay, for example, display statistics or history for the broadcaster'ssales during the respective broadcast or through the respective channel.

FIG. 12 provides a non-limiting example of a game merchandisinginterface or virtual storefront for a game spectating system, accordingto some embodiments. A spectating UI 1202 may, for example be presentedas a Web page of a game spectating system website via a Web browser, asan interface to a game spectating Web application or mobile application,or as an interface to other network-based game spectating applications.A spectating UI 1202 may include one or more panes or regions includingone or more of, but not limited to, controls 1210, a video player 1232with A/V controls 1233, and a game merchandising interface 1240 viawhich a spectator may view and interact with broadcast content based atleast in part on game metadata for the game being broadcast 1234 toobtain information and statistics for game-related content, and toorder, purchase, or otherwise obtain game-related content ormerchandise. Controls 1210 may include one or more UI elements fornavigating or otherwise interacting with the game spectating system.Video player 1232 displays the video stream (shown as broadcast 1234)for a live broadcast or channel or for a replay of a previously recordedbroadcast. In some embodiments, spectating UI 1202 may also include achat 1236 pane in which broadcaster and/or spectator text chat may bedisplayed, for example chat discussing game information and game-relatedcontent such as the game-related content displayed as broadcast contentin game merchandising interface 1240.

Game merchandising interface 1240 may, for example, include broadcastcontent that provides information for the game being broadcast and forcontent of the game based at least in part on the game metadata receivedfrom the respective game system, and that the viewer may interact withto explore, view, and interact with detailed information about andstatistics for game content (objects, gear, characters, players,locations, events, etc.) based at least in part on the game metadata forthe game being broadcast 1234. At least some of the broadcast contentdisplayed in game merchandising interface 1240 may be interactive UIelements that, for example, allow the viewer to get additionalinformation about the game or game content based at least in part on thegame metadata obtained from the game system, and to order, purchase, orotherwise obtain the game or game content. For example, in someembodiments, the viewer may interact with the UI elements displayed ingame merchandising interface 1240 to obtain information about and/orstatistics for game-related content or merchandise, to order, purchase,or otherwise obtain virtual items for use within the game (a DP9000disruptor pistol or Harpoon XL ship, in this example), to order orpurchase a physical model of a virtual item from a merchant ormanufacturer (a model of a DP9000 disruptor pistol or Harpoon XL ship,in this example), and/or to order, purchase, or otherwise obtaingame-related merchandise such as t-shirts or hats. As another example,the viewer may interact with the UI elements displayed in gamemerchandising interface 1240 to get more information about or statisticsfor the game (“Space Explorers”, in this example), or to obtain orpurchase the game, from the game system provider or from some othersource.

In some embodiments, the game merchandising interface 1240 may includeUI elements via which the spectators may obtain more information from abroadcaster or other expert. For example, as shown in FIG. 12, theinformation box for the DP9000 Disrupter Pistol includes an “Ask theExpert” UI element that the spectator can select to message thebroadcaster for more information about the item. Selecting the “Ask theExpert” UI element may cause a message to be displayed on thebroadcaster's device requesting more information about the particularitem. The broadcaster may then respond in audio or text commentary todescribe the item, or provide the information through other sources suchas e-mail or links to pages that include descriptive information.

As shown in this example, the viewer has interacted with the broadcastcontent displayed in game merchandising interface 1240 to select theDP9000 Disrupter Pistol to view descriptive information about thisparticular game-related item. The descriptive information may, forexample, include image(s) and a textual description of the item. Forexample, for a weapon, the descriptive information may indicate therange, capacity, and effectiveness of the weapon. In some embodiments,the descriptive information may include usage information for aparticular item or type of item. For example, a list of all the playerswho use an item such as a particular sword or other weapon may beprovided. In some embodiments, the descriptive information may includestatistical data about the in-game item, for example statistics on whichcharacters/players use an item, how they use it, the item's history orsuccess, and so on. In some embodiments, for a weapon or other piece ofin-game gear, popularity or ratings based on player usage and/orparticipant voting may be provided. In this example, the viewer mayselect the “GET IT!” UI element associated with the item to obtain avirtual DP9000 pistol for use within the Space Explorers game and/or toorder or purchase a physical model of the DP9000 pistol from a gamesystem provider, online merchant, manufacturer, or other entity.

In some embodiments, broadcast 1234 may include overlay content thatallows the viewer to interact with the broadcast 1234, for example asillustrated in FIG. 7B. For example, in some embodiments, the viewer mayselect content in broadcast 1234 to open an overlay window that providesadditional information about the content based at least in part on thegame metadata obtained from the game system as illustrated in FIG. 7B.As another example, in some embodiments, the viewer may select gamecontent in broadcast 1234 to display broadcast content related to theselected game content in game merchandising interface 1240. For example,the spectator may select a particular in-game character to displaybroadcast content for the selected character's gear in gamemerchandising interface 1240. FIG. 7B provides an example where theviewer has selected player E in the overlay window to view the itemscurrently in player E's gear set in a game content details pane.

Game Participation Interface

Embodiments of a spectating system are described that may interact withgame systems to allow viewers or spectators to join or “step into” gamesbeing broadcast via the spectating system in a game spectatingenvironment. In some embodiments, the spectating system may alsofacilitate acquisition and provisioning of game records or game statesfor previously played game sessions that allow the spectators to replaythe session. A spectating user interface (UI) may display broadcastcontent including UI elements via which spectators can obtain gameclient software for participating in trial or full versions of a game,as well as game states for games currently being broadcast and gamerecords for previously played game sessions. Game client software, gamestates, and/or game records may be downloaded to the spectator's devicesin response to spectator requests via the spectating UI. The spectatorscan obtain characters, avatars, gear, and/or other game content for usein the games via the spectating UI. Using the spectating system tofacilitate acquisition of game client software and game states,spectators may join live game sessions of online games, start new gamesessions, or replay previously recorded game sessions. A spectator canobtain an in-game character and “load out” or equip the character,obtain an executable version of the game, obtain and “step into” gamestates, and step into or become characters or clones of characters inthe game sessions, all via the spectating system interfaces.

In some embodiments, the spectating system may leverage game metadata toallow spectators to join or “step into” games being broadcast via thespectating system. In some embodiments, the broadcast content presentedto the spectators on a spectating UI may include user interface elementsvia which spectators can order, purchase, or otherwise obtain demo,trial, or full versions of games. In some embodiments, game clientsoftware and game data for participating in demo, trial, or fullversions of online games may be obtained and downloaded to thespectator's devices via the spectating system interfaces and broadcaststreams. In some embodiments, the broadcast content presented to thespectators on a spectating UI may include UI elements via whichspectators can order, purchase, or otherwise obtain characters, avatars,gear, or other game content for participation in particular games. Insome embodiments, the obtained game content may be downloaded to thespectators' devices via the spectating system interfaces and broadcaststreams. In some embodiments, using the spectating UI to obtain the gameclient software, game data, and game content via the broadcast streams,the spectators may join live game sessions of online games, start newgame sessions, and/or replay previously recorded game sessions.

In some embodiments, the spectators may use the spectating UI to obtainthe game client software, game data, and game content (e.g., gamecharacters and gear) via the broadcast streams, and may also obtain,“step into”, and replay game records of previous game sessions. In someembodiments, game records and/or game states can be purchased orotherwise obtained via the spectating system interfaces and broadcaststreams. In some embodiments, the broadcast content presented to thespectators on a spectating UI may include user interface elements viawhich one or more game records and/or game states may be advertised,obtained by the spectator, and used to regenerate the game sessionuniverse and start or resume game play at a point in the game sessiontimeline. In some embodiments, the spectator may become a player andstep into the game session universe and timeline either using their ownin-game character or avatar or stepping into and taking control of acharacter that is already in the game session. In some embodiments, thebroadcast content presented to the spectators on a spectating UI mayinclude user interface elements via which spectators can view, order,purchase, or otherwise obtain game content including but not limited tocharacters, avatars, and gear of other players, including but notlimited to broadcasters, that participate in particular games. Thus, insome embodiments, a spectator can obtain an in-game character and “loadout” or equip the character, obtain an executable version of the game,obtain and “step into” game records or game states, and step into orbecome characters or clones of characters in the game sessions, all viathe spectating system interfaces and broadcast streams.

In at least some embodiments, indications of player inputs to the gamefor at least some of the players in the game may be received from thegame systems according to the game system API presented to the gamesystems by the spectating system. A player input may be a single commandor action input to the game from a respective player's game client orgame controller. A player input or a combination of player inputs maycause, be involved in, or be associated with a game event. In someembodiments, player inputs to a game may be stored as part of a gamerecord with one or more game states and other game information to form arecord of a particular game session (referred to as a game record) thatmay, for example, be vended to clients including but not limited tospectators. A game record including player inputs may be replayed, andin some embodiments a viewer of a replay may “step into” the replay asdescribed later in this document.

In some embodiments, a “ghosting” mode may be supported when joininggame sessions from obtained game records or game states. In ghostingmode, a player may jump into a game being broadcast, or replay apreviously recorded game session of a broadcaster/player, via thespectating system interface. The original player's character/gear (e.g.,racecar) may still be visible as a “ghost” to the new player. Thus, thenew player may compare their performance to that of the original playerby viewing the original player's “ghost” during replay. In addition, theoriginal player's broadcast commentary (video, audio, and/or text) maybe played or displayed to the new player. As an example, the new playermay use the ghosting mode as a training tool to learn how a skilled oraccomplished broadcaster/player has played a difficult level orchallenge within the game.

FIGS. 13A through 13E illustrate provisioning game client software andgame states to a spectator device in a game spectating environment, forexample a game spectating environment as illustrated in FIG. 1A or FIG.1B, according to some embodiments. As shown in FIG. 13A, a gamespectating environment may include a spectating system 100, a gamesystem 120, a broadcaster device 140, and a spectator device 160.

Typically, a game system 120 may include a game engine 1322 that, forexample, renders a 2D or 3D representation of a game universe based onthe current state of the universe, generates video and sound, and sendsor streams the video and sound (A/V) output 121 to client devicesincluding but not limited to broadcaster device(s) 140 for display. Thegame supported by game engine 1322 may be a multiplayer online game inwhich two or more players remotely participate in online game sessions,a single-player online game, or a single-player or multiplayer game thatis or can be played locally/offline.

A broadcaster device 140 may include, but is not limited to, input andoutput components (including but not limited to input devices andtechnologies such as controllers or joysticks, motion tracking systems,gesture-based input systems, etc.) and game client 141A software and/orhardware for at least one game system 120 via which respective playerscan participate in game sessions currently being executed by the gamesystem(s) 120. A broadcaster device 140 may also include input andoutput components (e.g., video cameras and microphones) and broadcastingclient software and/or hardware 143 for the spectating system 100 viawhich respective players may generate live A/V streams of their onlinegame play (broadcasts 142) and other broadcaster input including but notlimited to audio and textual commentary for broadcasting to spectatorsvia the spectating system 100.

A spectating system 100 such as the spectating system 100 as illustratedin and described for FIGS. 1A and 1B may implement one or morecomponents or modules that may stream broadcasts 142 and presentbroadcast content 126 to spectators via a spectating UI on respectivespectator devices 160. FIG. 14 provides a non-limiting example of aspectating UI, according to some embodiments. The broadcast content 126may be determined at least in part from game metadata 124 received fromthe game system(s) 120 according to a game system API provided by thespectating system 100. In some embodiments, the broadcast content 126may be determined at least in part from game-related data acquired fromone or more other sources such as online merchants or data stores ofgame-related data.

A spectator device 160 may include, but is not limited to, input andoutput components (including but not limited to input devices andtechnologies such as controllers or joysticks, motion tracking systems,gesture-based input systems, etc.) and may include spectating clientsoftware and/or hardware via which respective spectators may interactwith the spectating system 100 to select, receive, and view broadcasts142 from the broadcaster devices 140 or playbacks of previously recordedbroadcasts, and via which the spectators may provide spectator inputs165 including but not limited to audio or textual chat or “crowd noise”for broadcasts 142 and spectator interactions 164 with broadcast content126 including but not limited to content generated at least in part fromgame metadata 124 received from game system(s) 120 by the spectatingsystem 100 and presented on the spectator device 160 via a spectatingUI. FIG. 14 provides a non-limiting example of a spectating UI that maybe provided on a spectator device 160 by the spectating system 100,according to some embodiments. In some embodiments, spectator inputs andinteractions may also include inputs from and/or interactions with inputdevices and technologies such as controllers or joysticks, motiontracking systems, gesture-based input systems, and so on.

In some embodiments, spectating system 100 may process at least some ofthe spectator inputs 165 and/or interactions 164 to generate requests105 to the game system 140, for example requests for particular gamemetadata 124 or requests to obtain game client software, game states,and game content. As shown in FIG. 14, the spectating UI may include agame participation interface that provides broadcast content includingUI elements with which the spectator can interact to generate variousrequests for game client software, game states, and game content

FIGS. 13B and 13C illustrate providing access to the game via astreaming system 1300 and game streaming interface 1341. In someembodiments, full game play may be provided to a spectator device 160via a streaming service or system 1300 and game streaming interface1341, as illustrated in FIG. 13B. In some embodiments, demo or trialaccess to the game may be provided via the streaming system 1300 andgame streaming interface 1341. In FIG. 13B, a spectator viewing abroadcast 142 via spectator device 160 has interacted with a gameparticipation interface of the spectating UI, for example as illustratedin FIG. 14, to generate a request 1364 to participate in a trial versionof the game executing on game system 120. A trial version of the gamemay be provided via the streaming system 1300 and game streaminginterface 1341 for a specified time period, and may be provided for afee or for free. In response to the request 1364, a trial streamingversion of the game may be initiated to the game streaming interface1341 (e.g., a Web page) on the spectator device 160 via streaming system1300. Game stream I/O 1342 from the spectator device 160 to the gamesystem 120 may include, but is not limited to, player inputs to thegame. Game stream I/O 1342 to the spectator device 160 may include, butis not limited to, streamed video of at least partially rendered gamegraphics that are presented on the game streaming interface 1341. Inaddition, game software, game data, game records, game states, and/orgame content may be included in the game stream I/O 1342 to thespectator device 160.

FIG. 13C illustrates downloading a native game client to the spectatordevice 160 with the game stream I/O 1342, according to some embodiments.In some embodiments, a “background” download 1350 of native game client141B software for the spectator device 160 may be initiated to thespectator device 160 in response to the game trial request 1364, oralternatively may be initiated in response to additional or otherspectator interactions with the game streaming interface 1341. In someembodiments, the native game client 141B software may be downloaded inthe stream 1342 from the game system 120. In some embodiments, thenative game client 141B software may instead be downloaded in thebroadcast 142 stream from the spectating system 100. A download 1350 ofthe game client 141B software may typically take a significant amount oftime (e.g., 15-20 minutes or longer), so initiating the download 1350 inresponse to the game trial request 1364 or during the game trial periodmay allow a seamless switch from the trial version provided by the gamestreaming interface 1341 to the native game client 141B if and when thespectator decides to purchase the full version of the game, for examplevia the game participation interface of the spectating UI as illustratedin FIG. 14. Note that the downloaded game client 141B software may notbe activated until the spectator purchases the full version of the game.

FIG. 13D illustrates switching from the game client streaming interfaceto the native game client 141B on the spectator device 160, according tosome embodiments. At some point during or after the trial period, thespectator may interact with a game participation interface of thespectating UI, for example as illustrated in FIG. 14, to generate arequest 1366 to purchase the full version of the game executing on gamesystem 120. In response, the game client 141B, downloaded with thestream 1342 during the trial period, may be activated. In someembodiments, a current game state 1324 for the game may be obtained bythe game client 141B, either from the game streaming interface 1341 onspectator device 160 or from some other source including but not limitedto game system 140. The spectator may thus seamlessly continue playingparticipating in the game that was being played via the streaming system1300 and game streaming interface 1341. In some embodiments, the gamestate 1324 may be provided in the broadcast 142 stream from thespectating system 100.

The game supported by game client 141B may be a multiplayer online gamein which two or more players remotely participate in online gamesessions, a single-player online game, or a single-player or multiplayergame that is played locally/offline. For online games, game I/O 1344Amay include at least player inputs to the game executing on game system140, as well as graphics data or rendered graphics for display onspectator device, and may also include game software, game data, gamerecords, game states, and/or game content obtained by thespectator/player either via spectating system 100 or from other sourceincluding but not limited to game system 140. For offline games, theremay be no game I/O 1344A to a remote game system 160, or game I/O 1344Amay include game software, game data, game records, game states, and/orgame content obtained by the spectator/player either via spectatingsystem 100 or from other source including but not limited to game system140.

FIG. 13E illustrates getting a game state and stepping into a game froma game client 141B on a spectator device 160, according to someembodiments. A spectator may interact with a game participationinterface of the spectating UI, for example as illustrated in FIG. 14,to generate a request 1368 to purchase or otherwise obtain a game stateor game record for the game executing on game system 120. In response, arequested game state or game record 1325 (and possibly other gamemetadata) may be provisioned to the spectator device 160, either fromthe game system 140 or from some other source such as a data store ofthe spectating system 100, a third-party merchant, or a third-partstorage system. In some embodiments, the game state or record 1325 maybe provided in the broadcast 142 stream from the spectating system.

In some embodiments, for online games the spectator/player may use thegame client 141B and game state or record 1325 to join a game currentlyexecuting on spectating system 120 as a new character, or “step into”and take control of a character already in the game. In someembodiments, the spectator/player may use the game client 141B and gamestate or record 1325 to replay a game or portion of a previouslyrecorded game. In at least some embodiments, the game record is notsimply a video recording of the game play, but instead is an executablerecord of game play that may include data and information including butnot limited to the original player inputs that allow the previouslyrecorded game session to be replayed or re-executed by the game client141B or engine 1322. In some embodiments, the spectator/player may “jumpinto” the replay as a new character, or “step into” and take control ofa character already in the game replay.

FIG. 14 provides a non-limiting example of a game participationinterface for a game spectating system, according to some embodiments. Aspectating UI 1402 may, for example be presented as a Web page of a gamespectating system website via a Web browser, as an interface to a gamespectating Web application or mobile application, or as an interface toother network-based game spectating applications. A spectating UI 1402may include one or more panes or regions including one or more of, butnot limited to, controls 1410, a video player 1432 with A/V controls1433, and a game participation interface 1440. Controls 1410 may includeone or more UI elements for navigating or otherwise interacting with thegame spectating system. Video player 1432 may display the video stream(shown as broadcast 1434) for a live broadcast or channel or for areplay of a previously recorded broadcast.

While not shown, in some embodiments, spectating UI 1402 may alsoinclude a chat pane in which broadcaster and/or spectator text chat maybe displayed, for example chat discussing game information andgame-related content such as the game software, game states, gamerecords, and/or game content displayed as broadcast content in gameparticipation interface 1440. In addition, in some embodiments, the gameparticipation interface 1440 may include UI elements such as an “Ask theExpert” UI element via which the spectators may obtain more informationabout the game or game content from a broadcaster or other expert.Selecting the “Ask the Expert” UI element may cause a message to bedisplayed on the broadcaster's device requesting more information aboutthe game or particular game content. The broadcaster may then respond inaudio or text commentary, or may provide information through othersources.

The spectating UI 1402 may include a game participation interface 1440via which spectators may view and interact with broadcast content basedat least in part on game metadata for the game being broadcast 1434 toobtain information and statistics for the game and game-related content,and to order, purchase, or otherwise obtain access to game software,game states, game records, and/or game content that may allow thespectator to participate in the game, for example to join or “step into”the current game or to replay previously recorded games. At least someof the broadcast content displayed in game participation interface 1440may be interactive UI elements that, for example, allow the viewer toget additional information about the game or game content based at leastin part on the game metadata obtained from the game system, and toorder, purchase, or otherwise obtain the game, game states, gamerecords, or game content.

In the non-limiting example shown in FIG. 14, game participationinterface 1440 shows broadcast content for the example “Space Explorers”(SE) game. Note that similar interfaces 1440 may be provided for othergames, at least in part according to respective game metadata for thegames. The viewer may interact with UI elements displayed in gameparticipation interface 1440 to obtain descriptive information aboutand/or statistics for the SE game and game-related content, software,and data. In addition, the viewer may select a “Demo SE game” UI elementto obtain or access a demo or trial version of the SE game, for exampleas described in reference to FIGS. 13A-13E.

In some embodiments, the viewer may select a “Purchase SE game” UIelement to purchase, download, or activate a full version of the SE gameclient, for example as described in reference to FIGS. 13A-13E. In someembodiments, the viewer may select a “Purchase SE game state” UI elementto purchase or otherwise obtain game states and/or game records that mayallow the viewer, via a demo or trial version or the full version of thegame client, to join current games, replay previously recorded games,step into games or game characters, and so on, for example as describedin reference to FIGS. 13A-13E. In some embodiments, the viewer mayselect a “Get SE game content” UI element to purchase or otherwiseobtain game content, including but not limited to gear, avatars, maps,and the like. For example, in some embodiments, selecting the “Get SEgame content” UI element may take the viewer to a game merchandisinginterface 1240 as illustrated in FIG. 12. In some embodiments, theviewer may select a “Clone SE character” UI element to purchase orotherwise obtain a clone of a specific game character (in this example,player F's character). Obtaining the clone may, for example, provisionthe viewer's game client or game account with the character/avatar ofthe player F, and may also “load out” or provide at least some of thegear belonging to the player F to the viewer's game client or gameaccount.

In some embodiments, the viewer may select a “Step into SE game” UIelement to step into the game session being broadcast 1434. The gamesession being broadcast 1434 may be may be a live game session executingon a game system, or may be a replay of a previously played session, forexample a session being replayed from a game record. Stepping into thegame session may start the local game client on the spectator device toexecute the game from a respective game state or game record, oralternatively the game may be stepped into and played using a streamingclient, for example as illustrated in FIGS. 13A-13E.

FIG. 15A is a flowchart of a method for facilitating game acquisitionand participation via a game spectating system, according to someembodiments. The method of FIG. 15A may, for example, be implemented bya spectating system 100 as illustrated in FIG. 1A, FIG. 1B, or FIGS.13A-13E. As indicated at 1500 of FIG. 15A, the spectating system maystream broadcasts of game play to spectator devices. As indicated at1502 of FIG. 15A, the spectating system may provide a game participationinterface on the spectator devices. FIG. 14 shows an example gameparticipation interface. As indicated at 1504 of FIG. 15A, thespectating system may provide broadcast content giving access to gamesoftware and/or game data via the game participation interface based atleast in part on game metadata received from the game, for example asdescribed in reference to FIG. 14. As indicated at 1506 of FIG. 15A, thespectating system may receive input from a spectator device accessinggame software and/or game data via the game participation interface, forexample as described in reference to FIGS. 13A-13E and FIG. 14. Asindicated at 1508 of FIG. 15A, the spectating system may facilitateprovisioning of the requested game software and/or game data to thespectator device, for example as described in reference to FIGS.13A-13E. As indicated at 1510 of FIG. 15A, the spectator may beginparticipating as a player in the game, for example as described inreference to FIGS. 13A-13E.

FIG. 15B is a flowchart of a method for stepping into a game via a gamespectating system, according to some embodiments. The method of FIG. 15Bmay, for example, be implemented by a spectating system 100 asillustrated in FIG. 1A, FIG. 1B, or FIGS. 13A-13E. As indicated at 1520of FIG. 15B, the spectating system may receive input from a spectatordevice indicating that the spectator wants to join or “step into” acurrently executing game or previously recorded game, for example asdescribed in reference to FIG. 14. As indicated at 1522 of FIG. 15B, inresponse to the input, the spectating system may facilitate provisioningof game software and/or game data to the spectator device, for exampleas described in reference to FIGS. 13A-13E. Note that the spectatordevice may already include game client software, in which case game data(e.g., one or more game states) may be downloaded or otherwiseprovisioned to the game client. As indicated at 1524 of FIG. 15B, thespectating system may facilitate provisioning of game content to thespectator device or account, for example in response to input to a gameparticipation interface as described in reference to FIG. 14. Asindicated at 1526 of FIG. 15B, the spectator may begin participating asa player in the game, for example as described in reference to FIGS.13A-13E.

FIG. 15C is a flowchart of a method for cloning and provisioning a gamecharacter, according to some embodiments. The method of FIG. 15C may,for example, be implemented by a spectating system 100 as illustrated inFIG. 1A, FIG. 1B, or FIGS. 13A-13E. As indicated at 1540 of FIG. 15C,the spectating system may receive input from the spectator deviceobtaining or cloning a game character, for example input to a gameparticipation interface as described in reference to FIG. 14. Asindicated at 1542 of FIG. 15C, the spectating system may facilitateprovisioning of the game character to the spectator device or account,for example as described in reference to FIG. 14. As indicated at 1544of FIG. 15C, the spectating system may receive input from the spectatordevice obtaining game gear for the character, for example as describedin reference to FIG. 14 or FIG. 12. As indicated at 1546 of FIG. 15C,the spectating system may facilitate provisioning of the game gear tothe spectator's character, for example as described in reference to FIG.14 or FIG. 12.

FIG. 15D is a flowchart of a method for provisioning game clientsoftware to a spectator device in a game spectating environment,according to some embodiments. The method of FIG. 15C may, for example,be implemented by a spectating system 100 as illustrated in FIG. 1A,FIG. 1B, or FIGS. 13A-13E. As indicated at 1560 of FIG. 15D, thespectating system may receive input from a spectator device indicatingthat the spectator wants to try or demo a game, for example asillustrated in FIG. 13B. As indicated at 1562 of FIG. 15D, in responseto the request, the spectating system may initiate a game client trialstream to the spectator's device for the spectator, for example asillustrated in FIG. 13B. As indicated at 1564 of FIG. 15D, thespectating system may download a native game client to the spectatordevice in the stream, for example as illustrated in FIGS. 13C and 13D.As indicated at 1566 of FIG. 15D, the spectating system may receiveinput from the spectator device indicating that the spectator wants topurchase or activate the game, for example as illustrated in FIG. 13D.As indicated at 1568 of FIG. 15D, the native game client may beactivated on the spectator device in response to the spectator'spurchase of the game. As indicated at 1570 of FIG. 15D, the spectatormay resume or continue the game in the native game client on thespectator device, for example as illustrated in FIGS. 13D and 13E.

FIG. 15E is a flowchart of a method for obtaining game data on aspectator device, according to some embodiments. The method of FIG. 15Emay, for example, be implemented by a spectating system 100 asillustrated in FIG. 1A, FIG. 1B, or FIGS. 13A-13E. As indicated at 1580of FIG. 15E, a game client may be provided or provisioned to a spectatordevice, for example as illustrated in FIGS. 13A-13E. As indicated at1582 of FIG. 15E, the spectating system may receive input from thespectator device obtaining game data, for example as illustrated inFIGS. 12 and/or 14. The game data may include, but is not limited to,game state(s) that allow the spectator to join a game, game records thatallow the spectator to replay game sessions, and/or various game contentthat may be used in a game. As indicated at 1584 of FIG. 15E, thespectating system may provision the selected game data to the spectatordevice, for example as illustrated in FIG. 13A-13E, 12, or 14. Asindicated at 1586 of FIG. 15E, the spectator may start or step into agame on the game client according to the game data, for example asillustrated in FIGS. 13D-13E.

Participant Achievements and Rewards

In some embodiments, the spectating system may leverage the gamemetadata and/or broadcast metadata to provide rewards or otherwiseacknowledge spectating system participants (broadcaster/players,spectators, and/or commentators). In some embodiments, spectators may berewarded for participating in broadcasts or in particular events inbroadcasts or games being broadcast. In some embodiments, the spectatingsystem may analyze the game metadata and/or broadcast metadata to detectbig or significant events or highlights in broadcast streams, and mayreward at least some spectators for “being there” or viewing the bigevents. In some embodiments, spectators may be rewarded for interactingwith broadcasters, for example for actively participating in broadcastaudio or text chat channels.

Examples of spectator rewards may include but are not limited toacknowledgements or “badging” on the game spectating system interface,virtual or digital items such as in-game virtual gear, discounts or freeaccess to spectating system or game content, physical items such ast-shirts or hats, and points that may be collected and used to purchaseitems or win prizes.

In some embodiments, the spectating system may allow broadcasters toreward or promote particular spectators, for example by selecting aspectator who shows good knowledge of the game to be a commentator forthe game. In some embodiments, broadcaster/players may be rewarded forparticular accomplishments, for example in-game achievements such asperforming certain feats in front of crowds of certain sizes, orachieving certain levels of audience participation or support (audiencesize, enthusiasm, voting, etc.). As non-limiting examples, abroadcaster/player may be given an in-game health or strength boost ormay be rewarded with in-game powers, gear, weapons, or information basedon a growing audience size or audience enthusiasm as expressed throughaudio and/or textual spectator chat input. As another example, abroadcaster may get special or exclusive broadcast content added totheir broadcast channel display based on their achievements. As anotherexample, a broadcaster may receive monetary or other rewards forbringing in new follower or subscribers to the spectating system throughtheir broadcast channel.

FIG. 16 illustrates a participant rewards module in a game spectatingenvironment, according to some embodiments. A game spectating system 100such as the game spectating system 100 as illustrated in and describedfor FIGS. 1A and 1B may implement or have access to one or morecomponents or modules 1610 that may obtain achievement inputs from oneor more sources. The module 1610 may process the inputs to determineparticipants or groups of participants to receive rewards, and may alsoprocess the inputs to determine events and/or achievements for whichrewards are to be given. The module 1610 may also determine what therewards are that are to be provided to determined participants or groupsof participants, and generates reward outputs that are provided to oneor more destinations. While FIG. 16 shows the participant rewards module1610 as a component of spectating system 100, in some embodiments theparticipant rewards module 1610 may be implemented as an externalservice, or as a module of a game system 120 as illustrated in FIGS. 1Aand 1B.

Participant Reward Module Inputs

In some embodiments, the achievement inputs to a participant rewardsmodule 1610 may include one or more of, but are not limited to, thefollowing. The various achievement inputs may be considered alone or incombination to determine participants or groups of participants toreceive rewards, events and/or achievements for which rewards are to begiven, and/or rewards to provide to participants or groups ofparticipants.

Game Metadata 1624.

In some embodiments, the spectating system 100 may obtain game metadata1624 from game systems for which broadcasts are being streamed or fromone or more other sources, for example as illustrated in FIG. 1C. Insome embodiments, the game metadata 1624 for a game may include, but isnot limited to, indications and descriptions of events in the respectivegame. FIGS. 1A, 1B, 3A, and 3B show examples of receiving and processinggame metadata 1624 including game event data, according to someembodiments. In some embodiments, the game metadata 1624 may alsoinclude other information about the game and game players, for exampleidentities of players in the game, player accomplishments, playerstatistics and history, player inputs to the game, and so on. Gamemetadata 1624 may be provided to or obtained by participant rewardsmodule 1610 and used in determining events or achievements to berewarded, rewards, and reward recipients.

Broadcast Metadata 1630.

In some embodiments, the spectating system 100 may obtain and analyzevarious inputs from participants (players, broadcasters, commentators,and/or spectators) in the game spectating environment to detect eventsin or determine other information about the broadcasts and/or gamesexecuting on the game systems. The events and other informationdetermined from analyzing the participant inputs may collectively bereferred to as broadcast metadata 1630. FIGS. 3A, 3C, 3D, and 4 showexamples of obtaining and analyzing various inputs from participants togenerate broadcast metadata 1630 including broadcast events 494 asillustrated in FIG. 3D and other broadcast-related analysis information427 as illustrated in FIG. 4. Broadcast metadata 1630 may be provided toor obtained by participant rewards module 1610 and used in determiningevents or achievements to be rewarded, rewards, and reward recipients.

Time and Location 1635.

In some embodiments, temporal information (e.g., time of day, day ofweek or month, time zone, etc.) and/or geographical location information(e.g., city, state, region, country) for participants may be obtained byparticipant rewards module 1610 and used in determining events orachievements to be rewarded, rewards, and reward recipients.

Broadcast Statistics 1640.

In some embodiments, the spectating system 100 may collect or determinespectating statistics based on spectator participation in broadcasts.For example, the spectating system 100 may track the size of aparticular broadcaster's audience, or the combined size of the audiencesfor all broadcasters of a particular game. As another example, thespectating system may track subscribing spectators vs. non-subscribingspectators who are watching particular broadcasts or games. As anotherexample, statistics for the broadcasters' merchandise sales, audienceretention, audience subscription, and other statistics for broadcasts orrespective broadcaster channels may be collected. The various statisticsmay be provided to or obtained by participant rewards module 1610 andused in determining events or achievements to be rewarded, rewards, andreward recipients.

Participant History 1645.

In some embodiments, the spectating system 100 may maintain or obtainhistorical information for participants, for example players in gamesbeing broadcast. As described above, in some embodiments, player and/orbroadcaster historical and statistical information may be obtained fromthe game system or from other sources, for example as illustrated inFIG. 1C. Participant history 1645 may be provided to or obtained byparticipant rewards module 1610 and used in determining events orachievements to be rewarded, rewards, and reward recipients.

Participant Status, Profile, and Preferences 1650.

In some embodiments, participants' status information in the spectatingsystem 100 may be provided to or obtained by participant rewards module1610 and used in determining events or achievements to be rewarded,rewards, and reward recipients. The status information for a spectatormay, for example, indicate whether the spectator is a viewer, follower,subscriber, non-subscriber, and so on. Participant status may, forexample, be maintained in or with participant account, subscription, orregistration information. In some embodiments, participant status mayinstead or also include a participant's approval rating as determinedfrom other participants, for example ratings of broadcasters and/orplayers based on spectators' inputs. As another example of status, abroadcaster may be ranked at different levels according to audiencesize, number of followers, amount of sales, retention rate, and/or othermetrics or broadcast statistics.

In some embodiments, the spectating system 100 and/or game system(s) maymaintain profile and/or account information for participants that mayinclude information for the participants such as various demographic andlocation information that may be leveraged by participant rewards module1610 in determining events or achievements to be rewarded, rewards, andreward recipients.

In some embodiments, participants' preferences, for example spectatorviewing, game or game genre, broadcaster/channel, or other preferencesas specified by spectators via the spectating UI, determined fromspectator inputs and interactions, or obtained from other sources, maybe used by participant rewards module 1610 in determining events orachievements to be rewarded, rewards, and reward recipients.

Participant Recommendation Inputs 1655.

In some embodiments, participants (broadcasters/players, spectators,commentators) may make recommendations or nominations for participantsor groups of participants to receive recognitions or rewards, and/or forrewards to be given to recognized recipients. In some embodiments, theparticipants may vote on participants or groups of participants toreceive recognitions or rewards, or on the rewards to be given. In someembodiments, participants may specify, nominate, and/or vote onparticular events and/or achievements for which rewards are to be given.In some embodiments, the spectating system 100 may provide anachievements and rewards interface to spectators and/or broadcasters,for example as illustrated in FIG. 18, via which participants maynominate and vote on other participants to be recognized and/orrewarded. In some embodiments, a participant or group of participantsmay individually or collectively pay for merchandise that is selected tobe given as a reward to other participant(s). In some embodiments,participants may provide inputs to participant rewards module 1610 forrecommendations and rewards via other input channels, including but notlimited to email and social media channels such as “tweets” or instantmessaging (IMs).

Participant Gift Inputs 1660.

In some embodiments, participants (spectators, broadcasters/players,commentators) may individually or collectively select or specify otherparticipants or groups of participants to receive rewards, recognition,or gifts of game-related merchandise including but not limited to gamecontent that players can use within a game or other in-game benefitssuch as health boosts, information (e.g., maps), or lives. In someembodiments, the spectating system 100 may provide an achievements andrewards interface to spectators and/or broadcasters, for example asillustrated in FIG. 18, via which participants may give gifts to playersor other participants. In some embodiments, a participant or group ofparticipants may individually or collectively pay for the merchandisethat is given as a gift to other participant(s). In some embodiments,participants may provide inputs to participant rewards module 1610 togive gifts to participants via other input channels, including but notlimited to email and social media channels such as “tweets” or instantmessaging (IMs).

Third-Party Inputs 1665.

In some embodiments, third parties including but not limited to gamedevelopers, online merchants, game fan sites, and so on may provideinputs 1665 to the participant rewards module 1610. The inputs fromthird parties may include, but are not limited to, indications of eventsand/or achievements for which rewards are to be given, indications ofparticipants to be rewarded, and/or indications of rewards to be givento selected participants.

Participant Reward Module Outputs

In some embodiments, the various achievement inputs to a participantrewards module 1610 may be processed to determine reward outputs asillustrated in FIG. 16. The determined reward outputs may indicateevents or achievements to be rewarded, participants or groups ofparticipants to receive rewards, and/or rewards to provide toparticipants or groups of participants. In some embodiments, the rewardoutputs may include one or more of, but are not limited to, thefollowing.

Game Feedback 1670.

In some embodiments, the participant rewards module 1610 may providefeedback 1670 to the game system(s) 120. In some embodiments, thefeedback 1670 may indicate participants (e.g., players) that are to berewarded or recognized in the game, and/or may indicate particularrewards (e.g., in-game gear, health boosts, lives, maps, etc.) to begiven to specified participants in the game. In some embodiments, thegame may provide in-game audio and/or visual effects in response to thegame feedback 1670; these effects may be reflected in the broadcaststreams, and thus may provide visual and/or audio indications tobroadcast viewers of the in-game rewards and/or recipients.

Broadcast Content 1626.

In some embodiments, the participant rewards module 1610 may generatebroadcast content 1626 based on one or more of the achievement inputs,and may present the broadcast content 1626 to at least some participantsvia spectating system user interface(s), for example as illustrated inFIGS. 8, 9, and 18. In some embodiments, the spectating system 100 mayprovide an achievements and rewards interface to spectators and/orbroadcasters, for example as illustrated in FIG. 18, via which thebroadcast content 1626 may be presented. The broadcast content 1626 maybe targeted to particular spectators or groups of spectators, forexample according to the spectators' current selections, profiles, orpreferences, or according to who was rewarded, what they were rewardedfor, and with what they were rewarded. For example, the broadcastcontent 1626 may include UI elements presented on a UI that indicatepast events for which rewards or recognitions will be given. As anotherexample, the broadcast content 1626 may include UI elements thatindicate upcoming or current events for which rewards or recognitionswill or may be given. As another example, the broadcast content 1626 mayinclude UI elements that indicate participants (broadcasters,spectators, etc.) to which rewards or recognitions will or may be given.As another example, the broadcast content 1626 may include UI elementsthat indicate particular rewards or recognitions that will or may begiven, and the conditions or achievements for which the rewards orrecognitions will be granted. As another example, the broadcast content1626 may include active UI elements that indicate to particularparticipants or groups of participants that they have been given areward, and that provide a method and/or instructions for theparticipant(s) to obtain the reward, for example a link to a Web pagevia which the participant(s) can obtain the reward.

In some embodiments, at least some rewards may be given or obtained forfree. In some embodiments, at least some rewards may be given orobtained for a fee or cost. For example, discounts for certain items maybe given as rewards. As another example, exclusive virtual and/orphysical items or merchandise, access to game content or information,participation or spectating privileges for restricted game events, orother benefits and content including but not limited to game-relatedbenefits and content may be provided to participant(s) for a fee.

In some embodiments, the broadcast content 1626 may include overlays(e.g., overlay video, text, etc.) that may be added to the broadcastvideo. For example, overlay text may be provided that announces past,present, or future events for which rewards will or may be given toparticipants. As another example, overlay text may be provided thatannounces participants (players, broadcasters, and/or spectators) thathave been granted rewards, that have been given gifts by otherparticipants or rewards by third parties, or participants or thirdparties that have given gifts or rewards to participants.

Broadcaster/Player Rewards 1680.

Broadcaster/player rewards 1680 may include, but are not limited to,rewards presented for participating in particular events in games orbroadcasts, or for reaching certain achievements in games or broadcasts.Broadcaster/player rewards 1680 may also include rewards granted orgiven by other participants, or rewards determined in various otherways. Broadcaster/player rewards 1680 may, for example, includegame-related physical and/or virtual items or merchandise including butnot limited to game content that players can use within a game or otherin-game benefits such as health boosts, information (e.g., maps), orlives. As another example, broadcaster/player rewards 1680 may includespecial content or recognitions presented on the broadcasters' channels.As another example, broadcaster/player rewards 1680 may include specialcontent or recognitions such as “badges” presented on the broadcasters'channels, either temporarily or permanently. As another example,broadcaster/player rewards 1680 may include promoting or highlightingthe broadcaster's channel, broadcasts, highlight reels, and/orrecordings of broadcasts presented in “broadcasters”, “channels”,“highlights”, or “video on demand” panes of the spectating UI, forexample as illustrated in FIG. 6A.

In some embodiments, participant rewards module 1610 may providebroadcaster/player rewards 1680 or notifications thereof via thebroadcast user interface(s). In some embodiments, the spectating system100 may provide an achievements and rewards interface to spectatorsand/or broadcasters, for example as illustrated in FIG. 18, via whichbroadcaster/player rewards 1680 or notifications thereof may beprovided. In some embodiments, participant rewards module 1610 may alsoprovide broadcaster/player rewards 1680 or notifications thereof via oneor more other channels, including but not limited to email and socialmedia channels such as “tweets” or instant messaging (IMs).

In some embodiments, at least some broadcaster/player rewards 1680 maybe given or obtained for free. In some embodiments, at least somebroadcaster/player rewards 1680 rewards may be given or obtained for afee or cost. In some embodiments, the broadcaster/player rewards 1680may include discounts, coupons, special offers, or the like for variousgoods, merchandise, or services.

In some embodiments, at least some broadcaster/player rewards 1680 maybe recorded by the spectating system 100 or by other systems includingbut not limited to the game system(s) 120, for example in participants'profile and/or history information maintained by the spectating system100, game system(s) 120, or a third party.

Spectator Rewards 1685.

Spectator rewards 1685 may include, but are not limited to, rewardspresented for participating in particular events in games or broadcasts,or for “being there” when certain achievements were reached in games orbroadcasts. Spectator rewards 1685 may also include rewards granted orgiven by other participants, or rewards determined in various otherways. Spectator rewards 1685 may, for example, include free ordiscounted game-related physical and/or virtual items or merchandiseincluding but not limited to game content that can be used within agame. As another example, spectator rewards 1685 may include specialcontent or recognitions presented on the spectating UI of the spectatingsystem 100; the special content or recognitions may be temporary orpermanent. For example, spectator rewards 1685 may include specialcontent or recognitions such as “badges” presented on the broadcasters'channels, either temporarily or permanently, whenever the spectator(s)are participating in a broadcast. As another example, spectator rewards1685 may include special, discounted, or limited access to broadcasts,highlight reels, and/or recordings of broadcasts presented in“broadcasters”, “channels”, “highlights”, or “video on demand” panes ofthe spectating UI, for example as illustrated in FIG. 6A.

In some embodiments, participant rewards module 1610 may providespectator rewards 1685 or notifications thereof via the broadcast userinterface(s). In some embodiments, the spectating system 100 may providean achievements and rewards interface to spectators and/or broadcasters,for example as illustrated in FIG. 18, via which spectator rewards 1685or notifications thereof may be provided. In some embodiments,participant rewards module 1610 may also provide spectator rewards 1685or notifications thereof via one or more other channels, including butnot limited to email and social media channels such as “tweets” orinstant messaging (IMs).

In some embodiments, at least some spectator rewards 1685 may be givenor obtained for free. In some embodiments, at least some spectatorrewards 1685 rewards may be given or obtained for a fee or cost. In someembodiments, the spectator rewards 1685 may include discounts, coupons,special offers, or the like for various goods, merchandise, or services.

In some embodiments, at least some spectator rewards 1685 may berecorded by the spectating system 100 or by other systems including butnot limited to the game system(s) 120, for example in participants'profile and/or history information maintained by the spectating system100, game system(s) 120, or a third party.

Participant Feedback 1690.

In some embodiments, participant rewards module 1610 may providefeedback to at least some participants for at least some of thebroadcaster/player 1680 and spectator 1685 rewards. The feedback 1690may, for example, include various visual and/or audio effects presentedto at least some participants via spectating system user interface(s),for example as illustrated in FIGS. 8, 9, and 18. The feedback may, forexample, announce or display rewards and reward recipients, announce orpromote upcoming events for which rewards may be given, or in generalprovide various information about rewards, recipients, andreward-related events to participants via audio and/or visual channels.In some embodiments participant rewards module 1610 may also providefeedback 1690 to participants via one or more other channels, includingbut not limited to email and social media channels such as “tweets” orinstant messaging (IMs).

Participant Reward Processing

Embodiments of a participant reward module or service 1610 may obtainvarious achievement inputs as described above from one or more sources,and may process the inputs to determine participants or groups ofparticipants to receive rewards, events and/or achievements for whichrewards are to be given, and what the rewards are that are to beprovided to determined participants or groups of participants. Theparticipant reward module 1610 generates reward outputs as describeabove, and provides the outputs to one or more destinations.

As a non-limiting example of a participant reward module 1610 processingthe achievement inputs to generate rewards outputs, game developers, thespectating system provider, or other entities may provide specificationsfor particular events or achievements in games or broadcasts that are tobe rewarded. The specifications may indicate an event or achievement tobe rewarded if accomplished (as non-limiting examples, a playeraccomplishing a feat, overcoming an obstacle, or gaining a level in thegame; a broadcaster's audience reaching a threshold size; a playerperforming a feat before an audience of a particular size; a broadcasterselling a certain amount of merchandise in a specified period; aparticular potential or upcoming event in a game or broadcast for whichparticipants are to be rewarded; a spectator or spectators that haveachieved some spectating system participation threshold; etc.) Thespecifications may indicate other parameters, such as time, location,and demographics parameters. The specifications may also indicaterewards and recognitions (e.g., virtual or physical merchandise,spectating interface badges, coupons or discounts, special or exclusiveoffers, etc.) that are to be provided for the specified events orachievements. The specifications may also indicate destination(s) forthe reward outputs. The participant reward module 1610 may receivevarious achievement inputs from the spectating system, game system(s),or other sources, for example game metadata and/or broadcast metadatathat indicates events in games and/or broadcasts, and may compare thoseto the specified events and accomplishments. When an event oraccomplishment is identified, the participant reward module 1610 mayobtain or determine the participants (e.g., broadcaster, players, andspectators) that have achieved the accomplishment or participated in theevent. The specified reward(s) may then be mapped to recipients of therewards. In some embodiments, different recipients may receive differentrewards for the same event or accomplishment, for example based on therecipients' profiles, preferences, or spectator grouping (e.g., viewer,follower, or subscriber). Reward outputs may then be provided toappropriate ones of the output destinations to facilitate provisioningof the rewards to the recipients. Note that other methods may be used toprocess at least some of the achievement inputs to determine andgenerate reward inputs.

FIG. 17A is a high-level flowchart of a method for recognizing orrewarding participants in a game spectating environment, according tosome embodiments. As indicated at 1700 of FIG. 17A, various achievementinputs or metrics may be obtained. As indicated at 1702 of FIG. 17A, theachievement inputs may be analyzed to determine participants to berewarded, for example by a participant rewards module 1610 asillustrated in FIG. 16. In some embodiments, for example, theparticipant rewards module 1610 may analyze the achievement inputs,including but not limited to broadcast metadata and game metadata, todetermine past, present, and/or future events in games or broadcasts forwhich rewards may or will be given, to determine the participant(s) towhich rewards may or will be given, and to determine what the respectiverewards may or will be. As indicated at 1704 of FIG. 17A, rewards may beprovided to the recognized participants, for example as described inreference to FIG. 16. As indicated at 1706 of FIG. 17A, content andfeedback indicating and/or or announcing the rewards may be provided,for example as described in reference to FIG. 16. The indications and/orfeedback may be provided to the participants, game system(s), and one ormore third parties, and may be provided via one or more channelsincluding one or more of but not limited to UIs, APIs, and social mediachannels.

FIG. 17B is a high-level flowchart of a method for rewardingparticipants in notable events in games being broadcast, according tosome embodiments. As indicated at 1750 of FIG. 17B, the spectatingsystem may stream a broadcast of game play received from a broadcasterdevice to one or more of a plurality of spectator devices, for exampleas illustrated in FIG. 1A and FIG. 18. The broadcast may be of a livesession in an online game or a replay of a previously recorded game. Asindicated at 1752 of FIG. 17B, a notable event in the game and/orbroadcast may be determined at least in part from game event dataobtained from the game system. Other data, including but not limited todata indicating broadcast and/or game events determined from analysis ofbroadcast audio, text, and/or other inputs, may also be used indetermining notable events. Notable events may be determined, forexample by a participant rewards module 1610 as illustrated in FIG. 16that processes various achievement inputs to determine reward outputs.As indicated at 1754 of FIG. 17B, a reward for participating in thenotable event may be determined, for example by a participant rewardsmodule 1610 as illustrated in FIG. 16. As indicated at 1756 of FIG. 17B,participants in the notable event may be determined, for example by aparticipant rewards module 1610 as illustrated in FIG. 16. As indicatedat 1758 of FIG. 17B, the reward may be provided to the participants, forexample by one or more channels or methods as described in reference toFIG. 16.

FIG. 18 provides a non-limiting example of achievements and rewardsinterfaces for a game spectating system, according to some embodiments.A participant UI 1802 may, for example be presented to participants(e.g., spectators and broadcasters) as a Web page of a game spectatingsystem website via a Web browser, as an interface to a game spectatingWeb application or mobile application, or as an interface to othernetwork-based game spectating applications. A participant UI 1802 mayinclude one or more panes or regions including one or more of, but notlimited to, controls 1810, a video player 1832 with A/V controls 1833,and an achievement and awards interface 1840. Controls 1810 may includeone or more UI elements for navigating or otherwise interacting with thegame spectating system. Video player 1832 may display the video stream(shown as broadcast 1834) for a live broadcast or channel or for areplay of a previously recorded broadcast. While not shown, in someembodiments, participant UI 1802 may also include other content orpanes, such as a chat pane in which broadcaster and/or spectator textchat may be displayed, for example chat discussing the game and playersin the game, and other game-related information, events, and content.

The participant UI 1802 may include an achievement and awards interface1840 via which participants may view and interact with broadcast contentrelated to rewards and achievements for the game and/or the broadcast.At least some of the broadcast content displayed in achievement andawards interface 1840 may be interactive UI elements that, for example,allow participants to nominate or vote on other participants forrecognition or reward, to nominate or vote on broadcast or game eventsfor which rewards should be given, or to nominate or vote on the rewardsto be given. As another example, the broadcast content may include UIelements, as shown in the “give player gifts” 1846 pane, that allowparticipants to provide gifts to selected participants (e.g., players orbroadcasters). For example, as shown in FIG. 18, “give player gifts”1846 pane includes a “Choose a player” UI element that the participantmay select to view a list of players or teams of players; theparticipant may select one of the players or teams to view additionalinformation about the player or team (e.g., via a player info 1836window overlaid on the broadcast or presented in achievement and awardsinterface 1840). Note that the players or teams in the list may be, butare not necessarily, players in the current game being broadcast orreplayed. For example, in FIG. 18, the participant has selected “PlayerE” from the list to view information on player E, including the player'sachievements, statistics, and gear. The participant may select a pieceof gear to give to the selected player. In some embodiments, instead ofor in addition to selecting players to receive gifts from a list asillustrated in FIG. 18, the spectating system may support drag and dropfunctionality whereby the spectator can drag items shown in the gifts1846 pane and drop the items onto a player's avatar or character onbroadcast 1834 pane to provide gifts to selected players.

FIG. 18 shows some non-limiting example gifts for the “Space Explorers”game, including gear such as a DP9000 disruptor pistol or LR20C laserrifle, a boost such as a health boost, and information such as a gamemap. In some embodiments, the participant(s) may pay for the gift(s),for example via a “Pay here” UI element as illustrated in FIG. 18. Asanother example of active broadcast content, the broadcast content mayinclude UI elements, as shown in the “my rewards” 1848 pane, via whichparticipants can obtain rewards that they have been granted or given,for example links to other pages or Web sites of third parties or gamedevelopers that provide the rewards, or links to pages where theparticipants can pay for, redeem, or otherwise obtain rewards. Inaddition to active broadcast content, the achievement and awardsinterface 1840 may include content that announces or publishes rewardand/or achievement information to the participants, for example as shownin the broadcast content of panes 1844, 1836, and 1848.

Game Effects from Spectating Community Inputs to the Spectating System

Using embodiments of methods and apparatus for integrating game systemswith a game spectating system in a game spectating environment asdescribed herein, games may be developed to be played in the gamespectating environment and interfaced with the game spectating system.For example, the game spectating system may provide an applicationprogramming interface (API) for game systems (referred to herein as agame system API). A software development kit (referred to herein as agame system SDK) may be provided to game developers that may assist thedevelopers in developing and programming games to support and interfacewith the game system API.

In some embodiments, the game system API and SDK may allow gamesexecuting on game systems to obtain various inputs from the gamespectating system. In some embodiments, the game spectating system maygenerate various game inputs based on spectating community inputs. Thespectating community inputs may include, but are not limited to,spectator participation statistics or metrics, spectator text chatinputs, spectator audio inputs, and spectating UI inputs. In someembodiments, the game inputs may include random number inputs generatedfrom one or more of the spectating community inputs that may be used asan entropy source for randomizing functions in a game. For example, at agame level where enemies are spawned for the player(s) to fight, arandom input from the spectating system based on spectating communityinputs may be used in determining the number, type, and/or strength ofthe enemies that are spawned. In some embodiments, the game inputs mayinclude parameter inputs that provide values for parameters in the gamebased on spectating community inputs. For example, at a game level whereenemies are spawned for the player(s) to fight, a parameter input fromthe spectating system may specify the number type, and/or strength ofthe enemies based on spectating community inputs.

Thus, embodiments may provide methods via which broadcast spectators maybecome involved in the games being broadcast by influencing game playvia their various inputs, while also enhancing game play for the playersby providing interesting variations in game play that are influenced bytheir spectating audience. For example, spectator text and/or audio chatin a broadcast streamed through the spectating system may be analyzed bythe spectating system to determine game inputs that influence certaindecisions made by the game engine. The analysis may, for example,measure metrics for the chat such as quantity or volume and provide themetrics as randomizing or parametric inputs to the game engine. Asanother example, the analysis may determine content (e.g., keywords orphrases) from the chat and collect and quantify the content to generaterandomizing or parametric inputs to the game engine. As another example,the analysis may determine metrics for crowd emotions or excitement fromthe chat and provide the metrics as randomizing or parametric parameterinputs to the game engine. One or more of the various metrics may bedetermined and provided to the game engine as randomizing or parametricinputs in real- or near-real time to be applied in making or influencingdecisions for game play. The game play may thus be influenced in veryreal and visible ways by the spectators' inputs in real- or near-realtime, allowing the spectators to view their influence on and thus senseand increase their involvement in the game.

FIG. 19A illustrates an example game effects module in a game spectatingsystem 100 that provides inputs to a game being broadcast via the gamespectating system based on spectator inputs to and interactions with thebroadcast, according to some embodiments. A game spectating system 100such as the game spectating system 100 as illustrated in and describedfor FIGS. 1A and 1B may implement one or more components or modules 1910that may provide randomizing 1992 and/or parametric 1994 game inputs toa game engine 1922 according to a game system API 114. The randomizing1992 and/or parametric 1994 game inputs may be determined from or basedon spectator inputs 165 such as text or audio chat inputs, spectatorinteractions 164 with broadcast content 126 determined at least in partfrom game metadata 124, spectating statistics 1982 collected by the gamespectating system 100, and/or other inputs 167 including but not limitedto inputs from social media such as “tweets” or instant messaging (IMs).In some embodiments, the spectating system 100 may obtain the gamemetadata 1624 from game system(s) 120 for which broadcasts 124 are beingstreamed according to game system API 114, or from one or more othersources as illustrated in FIG. 1C.

In some embodiments, the spectating system 100 may enable spectatorparticipation in broadcasts 142 to affect the game being executed by thegame engine 1922 in various ways. In some embodiments, the spectatingsystem 100 may determine information based on spectator participation inbroadcasts 142 and provide the information as feedback to the gamesystems 140 according to a game system API 114 presented to the gamesystems 140 by the spectating system 100. Spectator participationmetrics that may be used include but are not limited to crowd oraudience size for broadcasts or games, and spectator audio and/or textinputs 165 to broadcast “chat”, “crowd noise”, or other audio andtextual channels.

In some embodiments, the spectating system 100 may collect or determinespectating statistics 1982 based on spectator participation inbroadcasts. For example, in some embodiments, the spectating system 100may track the size of a particular broadcaster's audience, or thecombined size of the audiences for all broadcasters of a particulargame. As another example, the spectating system may track subscribingspectators vs. non-subscribing spectators who are watching particularbroadcasts or games. The statistics 1982 may be provided to or obtainedby game effects module(s) 1910 and used to determine randomizing 1992and/or parametric 1994 game inputs that are provided to the game engine1922 according to the game system API 114.

In some embodiments, the spectating system 100 may obtain and analyzespectator inputs including but not limited to spectator audio and/ortext inputs 165 to broadcast chat, “crowd noise”, or other audio andtextual channels of the broadcasts 142. In some embodiments, thespectating system 100 may instead or also include one or more interfacesthat can obtain, process, and analyze inputs from other input 167sources or channels, including but not limited to inputs from socialmedia such as “tweets” or instant messaging (IMs). The analysis may, forexample, determine metrics for the inputs 165 and/or 167 such asquantity or volume in chat channels, and may provide the metrics asrandomizing 1992 and/or parametric 1994 game inputs to the game engine1922 according to the game system API 114. As another example, theanalysis may determine content (e.g., keywords or phrases) from one ormore audio and/or textual chat channels or from a social media channel167 and collect and quantify the content to generate randomizing 1992and/or parametric 1994 game inputs to the game engine 1922. As anotherexample, the analysis may determine metrics for crowd emotions orexcitement from one or more spectator inputs 165 and/or other inputs 167and provide the metrics as randomizing 1992 and/or parametric 1994 gameinputs to the game engine 1922. FIG. 4 illustrates an exampleparticipant input processing component of a spectating system 100 thatmay obtain and analyze inputs including but not limited to spectatoraudio and/or text inputs 165 or other inputs 167 such as social mediainputs to determine broadcast-related analysis information. Thebroadcast-related analysis information may be used by the game effectsmodule(s) 1910 in generating randomizing 1992 and/or parametric 1994game inputs to the game engine 1922 according to the game system API114. The description of FIG. 4 also provides several examples ofdetecting and applying broadcast-related analysis information within agame spectating system to generate various randomizing 1992 and/orparametric 1994 game inputs.

In some embodiments, spectator participation in broadcasts may be usedto determine randomizing inputs 1992 to the game engine 1922 that may beused as randomizing factors in the game currently being executed andbroadcast. For example, one or more aspects or metrics of spectatorparticipation in a broadcast or broadcasts (crowd or audience size,crowd noise, chat level or volume, emotion or excitement level, etc.)may be measured or tracked and provided as feedback to the game system120 via the game system API 114 for use in the game engine 1922 as agame randomizing factor. For example, at a game level where enemies arespawned for the player(s) to fight, a randomizing input 1992 from thespectating system 100 based on spectator participation in one or morebroadcasts 142 of the game may be used in determining the number, type,and/or strength of the enemies that are spawned.

In some embodiments, spectator participation in broadcasts may be usedto determine parametric inputs 1994 to the game engine 1922 thatnon-randomly affect the game players and/or games being executed andbroadcast in various ways. As a non-limiting example, the size of acrowd or audience watching a broadcast 142 or broadcasts 142 of an eventin a game may be fed back to the game engine 1922, and may be used bythe game engine 1922 in determining the size or appearance of thestadium, arena or other event venue, the size of a virtual crowd ofspectators shown as viewing the event, and/or the volume of the crowdnoise provided as audio output with the game A/V 121 that is included inthe broadcast(s) 142. As another example, the level of crowd enthusiasmor support, for example as measured from the volume, quantity, orcontent of audio and/or text chat channel inputs 165 to a broadcast 142,may be fed back to the game engine 1922 to affect the number of “badguys” or monsters that appear at the current level that thebroadcaster/player is at, or may be used to reward the broadcaster atthe level by giving the broadcaster's in-game character or avatar accessto certain weapons, or may have various other in-game effects. Asanother example, spectators' audio and/or textual inputs 165 may beanalyzed to detect content or emotion (keywords, cheers, boos,happiness, etc.); the analysis may be fed back to the game and used toaffect players' in-game status, health, power, weapons, etc.

In some embodiments, spectator participations in broadcasts that areused to determine randomizing 1992 and/or parametric 1994 game inputs tothe game engine 1922 may include spectator interactions 164 withbroadcast content 126 presented via the spectating UI 116 on thespectator devices 160. For example, the broadcast content 126 mayinclude one or more UI elements that allow the spectating community tospecify, select, or vote on game elements or events such as what typeand how many enemies will appear at a level, what type of weapons orother gear players are given, difficulty levels, and so on.

In some games, for example as shown in FIG. 22, spectators may be fansof different teams, with different players on the different teams, andwith two or more different game engine instances executing to supportthe different teams and/or players. Different teams and/or players, andthus different game engines, may be affected by inputs to andinteractions with the same broadcast (or with different broadcasts ofthe same game). While FIG. 19A shows the game effects module(s) 1910 ofspectating system 100 communicating with a game engine 1922 of a gamesystem 120 via the game system API 114, in some embodiments, the gameeffects module(s) 1910 of spectating system 100 may instead communicatewith one or more game servers of the game system 120 to provide inputs1992 and 1994 to multiple game engine(s) 1922. The game server(s) may inturn communicate the inputs 1992 and 1994 to one, two, or more gameengine instances, as shown in FIG. 1D. The game engine instances may beinstantiated on one or more servers of the game system 120, oralternatively at least some of the game engine instances may be runningon the broadcaster devices 140 as illustrated in FIG. 19A. In someembodiments, the inputs 1992 and 1994 received from the game effectsmodule(s) 1910 of spectating system 100 may include at least some dataspecific to particular game engines (e.g., specific to different teamsand/or players), and the game server(s) may handle distribution of thedata to the target engines.

FIG. 19B illustrates example game input modules on a game system thatprocess spectating data received from a spectating system to generateinputs to a game being broadcast via the game spectating system,according to some embodiments. In some embodiments, in addition to orinstead of the game effects module(s) 1910 of a spectating systemgenerating values for parametric inputs 1994 and/or randomizing inputs1992 for a game engine(s) 1922, the game effects module(s) 1910 mayprocess the various inputs and interactions 164, 165, 167, and 1982 asshown in FIG. 19A to generate spectating data 1996, and may provide thespectating data 1996 to one or more game input module(s) 1930 of gamesystem(s) 120 according to game system API 114. The game input module(s)1930 may then generate values for parametric inputs 1994 and/orrandomizing inputs 1992 for the game engine(s) 1922. In someembodiments, instead of processing the various inputs and interactions164, 165, 167, and 1982, the game effects module(s) 1910 may collect oneor more of the inputs and/or interactions (e.g., audio or text chatinputs) and forward the inputs and/or interactions with little or noprocessing to the game input module(s) 1930 of game system(s) 120according to game system API 114.

FIGS. 20A through 20D are flowcharts of methods for generating inputs toa game system from spectators' interactions with and inputs tobroadcasts in a game spectating system, according to some embodiments.The methods of FIGS. 20A through 20D may, for example, be implemented ina spectating system environment as illustrated in FIG. 19A to generaterandomizing 1992 and/or parametric 1994 game inputs to a game engine1922.

FIG. 20A is a high-level flowchart of a method for generating inputs toa game system from spectators' interactions with and inputs to abroadcast in a game spectating system, according to some embodiments. Asindicated at 2000 of FIG. 20A, the spectating system may collectspectating information and inputs for a game being broadcast from one ormore spectating information sources. The spectating information andinputs may include, but are not limited to, spectator participationstatistics or metrics, spectator text chat inputs, spectator audioinputs, and spectating UI inputs.

As indicated at 2002 of FIG. 20A, the spectating system may generategame parametric inputs and/or randomizing inputs from the collectedspectating information and inputs. FIGS. 20B through 20D describeexample methods for generating parametric inputs and/or randomizinginputs from the collected spectating information and inputs, accordingto embodiments.

As indicated at 2004 of FIG. 20A, the spectating system may provide theparametric and/or randomizing inputs to the game via a game interface.In some embodiments, the spectating system may provide a game system APIfor game systems via which the game engines may specify and obtainparametric and/or randomizing inputs. In some embodiments, a game systemSDK may be provided to game developers that may assist the developers indeveloping and programming games to support and interface with the gamesystem API. The game system API and SDK may allow games executing ongame systems to specify and obtain parametric and/or randomizing inputsfrom the game spectating system.

As indicated at 2006 of FIG. 20A, the inputs may affect game executionand/or game play in various ways. For example, at a game level whereenemies are spawned for the player(s) to fight, a random input from thespectating system based on spectating community inputs or spectatingstatistics may be used in determining the number, type, and/or strengthof the enemies that are spawned. As another example, at a game levelwhere enemies are spawned for the player(s) to fight, a parametric inputfrom the spectating system may specify the number type, and/or strengthof the enemies based on spectating community inputs or interactions withbroadcast content.

FIG. 20B is a high-level flowchart of a method for generating inputs toa game system from spectator inputs to a broadcast in a game spectatingsystem, according to some embodiments. As indicated at 2010 of FIG. 20B,the spectating system may collect and process spectator inputs togenerate spectator input data. The spectator inputs may include, but arenot limited to, spectator audio and/or text inputs to broadcast chat,“crowd noise”, or other audio and textual channels of the broadcasts. Asindicated at 2012 of FIG. 20B, the spectating system may generate gameparameter inputs and/or randomizing inputs based at least in part on thespectator input data. For example, the analysis of the inputs may, forexample, determine metrics for the inputs such as quantity or volume ofspectator chat in chat channels, and may generate randomizing and/orparametric game inputs according to the metrics. As another example, theanalysis may determine content (e.g., keywords or phrases) from one ormore audio and/or textual chat channels, and may collect and quantifythe content to generate randomizing and/or parametric game inputs. Asanother example, the analysis may determine metrics for crowd emotionsor excitement from one or more spectator inputs and provide the metricsas randomizing and/or parametric game inputs to the game.

In some embodiments, to generate a randomizing input for the gamesystem, the spectating system may collect and process spectator audioand/or text chat inputs to generate an integer value that is passed tothe game engine as a randomizing input via the game system API. In someembodiments, the spectating system may be continuously receiving andprocessing spectator text and/or audio inputs to generate or change thevalues for the randomizing inputs. In some embodiments, the spectatingsystem may generate a value for a randomizing input in response to arequest for a random number received from the game engine via the gamesystem API.

In some embodiments, generating random values based on analysis ofspectator inputs may be leveraged to produce some interesting behaviorsin games. For example, a randomizing input may be weighted to have moreof an influence on the game as the number of spectators watching thebroadcasts of a particular game increases or crosses a threshold. Asanother example, when randomizing enemies or challenges in a game basedon analysis of spectator chat inputs, the spectator chat may increase orbecome more frequent or loud as the game gets more exciting. This changein spectator chat may be used to make the game more difficult, forexample by increasing the influence of the randomizing input, by raisingthe number of enemies that may be spawned, or by raising the difficultylevel that may be set. Thus, using spectators' inputs to randomize gameplay may provide a feedback loop in which changes in the spectators'inputs result in corresponding changes in game play. For example, as theplayers are playing the game, more enemies may be spawned. The increasedaction would be exciting for the viewers, which would be reflected inthe text and/or audio chat channels. The viewers' text and/or audio chatinputs are analyzed to provide randomizing inputs to the game enginethat may be influenced by the viewer's excitement level. So as theviewers' excitement level goes up, more enemies are spawned, and thegame gets more challenging and more exciting, and so on.

FIG. 20C is a high-level flowchart of a method for generating inputs toa game system from spectator statistics in a game spectating system,according to some embodiments. As indicated at 2020 of FIG. 20C, thespectating system may collect and analyze spectating data to generatespectating statistics. For example, in some embodiments, the spectatingsystem may track the size of a particular broadcaster's audience, or thecombined size of the audiences for all broadcasters of a particulargame. As indicated at 2022 of FIG. 20C, the spectating system maygenerate game parameter inputs and/or randomizing inputs based at leastin part on the spectating statistics. For example, a random value may begenerated based on the number of spectators currently viewing aparticular broadcasts or the number of spectators viewing all broadcastsof a particular game. As another example, a parametric input value maybe generated based on the current number of spectators. In someembodiments, the magnitude of the statistical value being monitored maybe used to apply weighting to the randomization effect in the game.

FIG. 20D is a high-level flowchart of a method for generating inputs toa game system from spectator interactions with broadcast content in agame spectating system, according to some embodiments. In someembodiments, spectator participation in broadcasts that are used todetermine randomizing and/or parametric game inputs to the game enginemay include spectator interactions with UI elements in the spectating UIon the spectator devices. As indicated at 2030 of FIG. 20D, thespectating system may provide game effects broadcast content to thespectator devices. For example, the broadcast content may include one ormore UI elements presented via the spectating UI on the spectatordevices that allow the spectating community to specify, select, or voteon game elements or events. As indicated at 2032 of FIG. 20D, thespectating system may receive and process spectator interactions withthe broadcast content to generate game parameter inputs. As non-limitingexamples, the UI elements may allow the spectators to specify, select,or vote on what type and how many enemies will appear at a level, whattype of weapons or other gear players are given, difficulty levels, andso on. The spectating system may collect and analyze the spectators'inputs to the UI elements to generate parametric inputs to the gameengine that indicate the spectators' specifications or choices for thegame elements or events as indicated by the broadcast content.

FIG. 21 provides a non-limiting example of a game spectating systeminterface that allows spectators to collectively affect a game beingbroadcast via the game spectating system, according to some embodiments.A spectating UI 2102 may, for example be presented as a Web page of agame spectating system website via a Web browser, as an interface to agame spectating Web application or mobile application, or as aninterface to other network-based game spectating applications. Aspectating UI 2102 may include one or more panes or regions includingone or more of, but not limited to, controls 2110, a video player 2132with A/V controls 2133, and a spectator effects pane 2140 via which aspectator may view and interact with broadcast content based at least inpart on game metadata for the game being broadcast 2134. Controls 2110may include one or more UI elements for navigating or otherwiseinteracting with the game spectating system. Video player 2132 displaysthe video stream (shown as broadcast 2134) for a live broadcast orchannel or for a replay of a previously recorded broadcast.

Spectator effects pane 2140 may include broadcast content based at leastin part on the game metadata for the game being broadcast. The broadcastcontent displayed in spectator effects pane 2140 may include interactiveUI elements via which spectators may specify, select, or vote on gamecontent, game elements, or game events such as what type and how manyenemies will appear at a level, what type of weapons or other gearplayers are given, difficulty levels, when or where enemies or othergame content will appear, and so on. Referring to FIG. 19A, spectators'interactions 164 with the broadcast content displayed in spectatoreffects pane 2140 of the spectating UI 2102 may be collected andanalyzed by the game spectating system 100 to determine values forparametric 1994 and/or randomizing 1992 inputs to the game engine 1922.In the non-limiting example spectating UI 2102 of FIG. 21, the broadcastcontent may include one or more UI elements that allow the spectatingcommunity to select what type of adversaries (“Bugeyes”, “Androids”, or“Cyborgs”) are to appear at a level of the game based on community votesas shown in the “Votes” column. The spectating system 100 collects andanalyzes the spectator votes, and provides the results to the gameengine 1922 as parametric input. In addition, the spectators may specifyhow many of the adversaries are to appear; the spectators' inputs to the“How many?” UI element are collected and analyzed (e.g., averaged), andthe results are provided to the game engine 1922 as parametric input.The spectating community may thus influence game play in very real andvisible ways in real- or near-real time via the spectating UI 2102provided by the spectating service 100, allowing the spectatingcommunity to view their influence on and thus sense their involvement inthe game. In addition, the game may be enhanced for the players byproviding interesting variations in game play that are influenced bytheir spectating audience.

FIG. 22 provides a non-limiting example of spectators' inputs to abroadcast in a game spectating system collectively affecting a gamebeing broadcast via the game spectating system, according to someembodiments. FIG. 22 provides a non-limiting example of a spectatinguser interface (UI) 2202 for a game spectating system on a device 2200in which spectators' inputs may result in visual and/or audio effects inthe game being broadcast. As shown in FIG. 22, a spectator's device 2200may implement a spectating UI 2202, and may include a microphone 2206 tocollect spectator 2220 audio and speakers 2204 to output game audio(including spectator audio and/or crowd noise, broadcaster commentary,etc.). The spectator's device 2200 may also include or be coupled to akeyboard 2209 or other input device(s) via which the broadcaster/player820 may enter text input such as broadcast chat 2218. In someembodiments, the spectator's device 2200 may also include or be coupledto input devices and technologies such as controllers or joysticks,motion tracking systems, gesture-based input systems, and so on.

In some embodiments, spectating UI 2202 may include a broadcast content2240 pane or region in which broadcast content based at least in part ongame metadata received from a respective game system may be displayed toand accessed by the spectator 2260. The broadcast content 2240 pane may,for example, show information about the game, game players, game objectsor items, game events, and so on as provided by the game system in thegame metadata. In some embodiments, spectating UI 2202 may includespectator controls 2216 via which the spectator 2260 may interact withthe spectating system to control the broadcast, select other broadcasts,and so on. In some embodiments, spectating UI 2202 may include abroadcast chat 2218 window via which the spectator 2260 may communicatewith the broadcaster/player and other spectators via text.

As described in reference to FIG. 4, in some embodiments, a participantinput processing component of the spectating system may obtain andanalyze spectator inputs including but not limited to spectator audioand/or text inputs to determine broadcast-related analysis informationthat may be used to generate randomizing 1992 and/or parametric 1994game inputs to the game engine 1922 according to the game system API114. For example, as shown in FIG. 22, virtual representations 2222 ofspectators (e.g., spectator avatars) may be divided into two or moregroups (e.g., fans of particular players or teams, in this example fansof teams A and B) in response to parametric 1994 game inputs based onprofile information for the respective spectators 2220 and/or analysisof the spectators' audio and/or textual inputs to detect the spectators'affiliations or preferences as described in reference to FIG. 4. Asshown in the example of FIG. 22, the virtual representations 2222 of thespectators on one side of a football stadium or basketball arena in anonline sports game (team B fans, in this example) may be made to standup, wave flags, or otherwise visually respond when the spectators 2220who are fans of a particular team and/or player are cheering or booingloudly in response to parametric 1994 game inputs as determined fromanalysis of the spectators' audio and/or textual inputs as described inreference to FIG. 4. In some embodiments, instead of or in addition tovisual indications, spectator audio output indicating sounds or noisesgenerated by the spectators or by particular groups of the spectatorsmay be provided to the spectators 2220 via the spectators' devices 2200in response to parametric 1994 game inputs as determined from analysisof the spectators' audio and/or textual inputs as described in referenceto FIG. 4.

Note that the content of the spectating UI 2202 may vary for differentspectators 2220, for example based upon profile, preference, and/or UIoptions and configuration information for the individual spectators 2220or group profile information for groups of spectators 2220. For example,the view of the game displayed in UI 2202 may vary based upon aspectator 2220's team affiliation. In addition, the audio output by thegame spectating system, for example via device 2200, may vary fordifferent spectators 2220 based upon profile, preference, and/or UIoptions and configuration information for the individual spectators 2220or group profile information for groups of spectators 2220. For example,in the example of FIG. 22, fans of team A may hear different crowd noisethan fans of team B.

Spectator Interactions with Games Via the Spectating System

Using embodiments of methods and apparatus for integrating game systemswith a game spectating system in a game spectating environment asdescribed herein, games may be developed to be played in the gamespectating environment and interfaced with the game spectating system.For example, the game spectating system may provide an applicationprogramming interface (API) for game systems (referred to herein as agame system API). A software development kit (referred to herein as agame system SDK) may be provided to game developers that may assist thedevelopers in developing and programming games to support and interfacewith the game system API.

In some embodiments, the game system API and SDK may allow gamesexecuting on game systems to provide game metadata to the spectatingsystem that may be used to generate game-related broadcast content thatis presented on a spectating user interface (UI), and to obtain variousspectator inputs to and interactions with the spectating UI from thespectating system according to the game system API. In some embodiments,the spectating system may generate various game inputs based on thespectating community inputs to and interactions with the spectating UI.In some embodiments, the spectating system may enable spectators tointeract with and affect the games being broadcast via the spectatingUI, and/or to interact with the broadcasters and players within thegames, in various ways. In some embodiments, individual spectators mayinteract with the games via the spectating UI to cause in-game effects.In some embodiments, groups of spectators may cause in-game effects orotherwise influence the game via the spectating UI, for example based onvoting. In some embodiments, the spectating system may leverage the gamemetadata to provide spectating UI elements with which spectators caninteract to provide inputs to interact with and affect respective games.In some embodiments, the spectating system may provide the spectatorinteractions as game inputs or feedback to the game systems according toa game system API presented to the game systems by the spectatingsystem.

In some embodiments, spectators may affect or influence the game,objects within the game universe, events within the game, or the playersin the game via the UI elements on the spectating UI. As non-limitingexamples, spectators may build buildings, hide weapons, set difficultylevels, select weather or other environmental factors, or otherwiseaffect game content and events via UI elements presented on thespectating UI. In some embodiments, spectators may provide game contentto or “gift” particular players or teams of players within a game viathe spectating UI, for example with objects, boosts, weapons, medicine,health points, strength levels, etc. In some embodiments, spectators canprovide information, for example maps, warnings, or advice, to playersor teams of players in a game via the spectating UI. In someembodiments, spectators may introduce challenges and difficulties to thegames or players within the games via the spectating UI, for example bycausing storms or other catastrophes, by increasing difficulty of gamelevels, tasks, or challenges, by taking objects from players, byreducing players' strength or limiting their powers, and so on. The gameplay may thus be influenced in very real and visible ways by thespectators' inputs to and interactions with the spectating UI in real-or near-real time, allowing the spectators to view their influence onand thus sense and increase their involvement in the game. In someembodiments, the UI elements may include UI elements that providemethods for spectators to purchase or otherwise pay for in-game contentor information to be provided to the players, and/or for other effectson the games that are provided via the UI elements.

In some embodiments, in addition to providing UI elements on thespectating UI via which spectators may affect or influence the gameexecuting on the game system, game inputs that affect or influence thegame may be determined from analysis of spectator inputs to thespectator devices including but not limited to text or audio inputs tothe spectator devices. For example, keywords or key phrases thatindicate spectator instructions to the game system may be determinedfrom analysis of text, audio, and/or other inputs such as social mediainputs as illustrated in FIG. 4. In some embodiments, spectator inputsfrom which game inputs may be determined may also include inputs fromdevices and technologies such as controllers or joysticks, motiontracking systems, gesture-based input systems, and so on.

In some embodiments, in addition to allowing spectators to affect orinfluence the game executing on the game system via inputs to andinteractions with the spectating UI, the spectating system may provideone or more UI elements via which the spectators may individually orcollectively provide information to the broadcaster. For example, asshown in FIGS. 25 and 26A, a community inputs pane includes “Look at:”UI elements via which a spectator can provide information to thebroadcaster, in this example location information for a hidden object.Inputs to the UI elements on the spectator device may cause the inputinformation to be displayed on the broadcaster's device, for example astext in a community inputs 2666 pane and/or as graphics in a map overlaywindow 2662 as shown in FIG. 26B. The information may be, but is notnecessarily, displayed on other spectators' devices. Note that thespectator devices and broadcast device may also include broadcast chatwindows via which spectators and broadcaster can communicate, and thatthe spectating system may also support audio chat via an audio chatchannel, as illustrated in FIGS. 25, 26A, and 26B.

In some embodiments, the spectating system may include one or morecomponents or modules, referred to herein as game interaction modules,that may provide game inputs to game engines executing on game systemsaccording to a game system API. In some embodiments, at least some ofthe game interaction modules may be provided by the spectating system.However, in some embodiments, at least some of the game interactionmodules may be developed according to the game system SDK and providedto the spectating system by third parties including but not limited tothe game developers. The game interaction modules may, for example,define the UI elements for interacting with the game, define the gameinputs for the game, and map inputs to and interactions with the UIelements to values for the game inputs. In some embodiments, the gamemetadata received from the game system according to the game system APIincludes information describing or representing game content for thegame, and at least some of the UI elements defined by the gameinteraction module(s) correspond to or represent the game content.

FIG. 23 illustrates a game interaction module in a game spectatingsystem that allows spectators to provide inputs that affect a game beingbroadcast via the game spectating system, according to some embodiments.A game spectating system 100 such as the game spectating system 100 asillustrated in and described for FIGS. 1A and 1B may include orimplement one or more components or modules 2310 that may provide gameinputs 2396 to a game engine 2322 according to a game system API 114. Atleast some of the game inputs 2396 may be determined from or based onspectator interactions 164 with broadcast content 126 determined atleast in part from game metadata 124 and presented to spectators viagame interaction UI(s) 2362 on the spectator device(s) 160. In someembodiments, the spectating system 100 may obtain the game metadata 1624from game system(s) 120 for which broadcasts 124 are being streamedaccording to game system API 114, or from one or more other sources asillustrated in FIG. 1C. In some embodiments, at least some of the gameinputs 2396 may be determined from spectator inputs 165 such as text oraudio chat inputs to the spectator device(s) 160. In some embodiments,values for game inputs 2396 may also be determined from other inputs tothe spectator device(s) 160 or spectating system 100 including but notlimited to inputs from social media such as “tweets” or instantmessaging (IMs). In some embodiments, the spectating system may obtainvideo or image inputs of spectator eye motion, body motion, or facialexpression from the spectator devices 160, process the video or imageinputs to determine metrics specifying interactions with the gameexecuting on the game system 120, and generate values for one or moregame inputs 2396 according to the determined metrics.

In some embodiments, the spectating system 100 may enable spectators tointeract with and affect the game being executed by the game engine 2322and broadcast 142 to the spectator device(s) 160 in various ways. Insome embodiments, the game interaction module(s) 2310 of spectatingsystem 100 may determine values for game inputs 2396 based on spectatorinteractions 164 and/or inputs 165, and provide the game inputs 2396 tothe game systems 140 according to a game system API 114 presented to thegame systems 140 by the spectating system 100.

In some embodiments, spectator inputs and interactions that determinevalues for game inputs 2396 to the game engine 2322 may includespectator interactions 164 with broadcast content 126 presented via thespectating UI 116 on the spectator devices 160, for example on gameinteraction UI(s) 2362. FIG. 25 illustrates an example spectating UIthat includes a game interaction user interface. In some embodiments,the game system API 114 and SDK may allow games executing on gamesystems 120 to provide game metadata 124 to the spectating system 100that may be used to generate game-related broadcast content 126 that ispresented on game interaction UI(s) 2362, and to obtain game inputs 2396determined according to various spectator inputs to and interactionswith the broadcast content of game interaction UI(s) 2362 from thespectating system 100 according to the game system API 114. In someembodiments, the spectating system 100 may generate various game inputs2396 based on the spectator and spectating community inputs to andinteractions with the game interaction UI(s) 2362. In some embodiments,the spectating system 100 may enable spectators to interact with andaffect the games being broadcast 142 via the game interaction UI(s)2362, and/or to interact with the broadcasters and players within thegames, in various ways. In some embodiments, individual spectators mayinteract with the games via the game interaction UI(s) 2362 to causein-game effects. In some embodiments, groups of spectators may causein-game effects or otherwise influence the game via the game interactionUI(s) 2362, for example based on voting.

In some embodiments, individual spectators and/or groups of spectatorsmay affect or influence the game, objects within the game universe,events within the game, or the players in the game via the UI elementson the game interaction UI(s) 2362. As non-limiting examples, spectatorsmay build buildings, hide weapons, set difficulty levels, select weatheror other environmental factors, or otherwise affect game content andevents via UI elements presented on the game interaction UI(s) 2362. Insome embodiments, spectators may provide game content to or “gift”particular players or teams of players within a game via the gameinteraction UI(s) 2362, for example with objects, boosts, weapons,medicine, health points, strength levels, etc. In some embodiments,spectators can provide information, for example maps, warnings, oradvice, to players or teams of players in a game via the gameinteraction UI(s) 2362. In some embodiments, spectators may introducechallenges and difficulties to the games or players within the games viathe game interaction UI(s) 2362, for example by causing storms or othercatastrophes, by increasing difficulty of game levels, tasks, orchallenges, by taking objects from players, by reducing players'strength or limiting their powers, and so on. The game play may thus beinfluenced in very real and visible ways by the spectators' inputs toand interactions with the game interaction UI(s) 2362 in real- ornear-real time, allowing the spectators to view their influence on andthus sense and increase their involvement in the game.

In some embodiments, the spectating system 100 may also obtain andanalyze spectator inputs including but not limited to spectator audioand/or text inputs 165 to broadcast chat or other audio and textualchannels of the broadcasts 142. In some embodiments, the spectatingsystem 100 may instead or also include one or more interfaces that canobtain, process, and analyze inputs from other input 167 sources orchannels, including but not limited to inputs from social media such as“tweets” or instant messaging (IMs). The analysis may, for example,determine content (e.g., keywords or phrases) from one or more audioand/or textual chat channels or from a social media channel 167 andcollect and quantify the content to generate game inputs 2396 to thegame engine 2322. FIG. 4 illustrates an example participant inputprocessing component of a spectating system 100 that may obtain andanalyze inputs including but not limited to spectator audio and/or textinputs 165 or other inputs 167 such as social media inputs to determinebroadcast-related analysis information. In some embodiments, thebroadcast-related analysis information may be used by the gameinteraction module(s) 2310 in generating game inputs 2396 to the gameengine 2322 according to the game system API 114.

In some embodiments, the spectating system 100 may provide one or moreUI elements via which the spectators may individually or collectivelyprovide information 2364 to the broadcaster. For example, as shown inFIGS. 25 and 26A, a community inputs pane includes UI elements via whicha spectator can provide information 2364 to the broadcaster. Inputs tothe UI elements on the spectator device 160 may cause the inputinformation 2364 to be displayed on the broadcaster device 140, forexample in a community inputs pane as shown in FIG. 26B. In someembodiments, the information 2364 may be, but is not necessarily,displayed on other spectators' devices 140. Note that the spectatordevices 160 and broadcast device 140 may also include broadcast chatwindows via which spectators and broadcaster can communicate, and thatthe spectating system may 100 also support audio chat via an audio chatchannel, as illustrated in FIGS. 25, 26A, and 26B.

In some games, for example as shown in FIG. 22, spectators may be fansof different teams, with different players on the different teams, andwith two or more different game engine instances executing to supportthe different teams and/or players. Different teams and/or players, andthus different game engines, may be affected by inputs to andinteractions with the same broadcast (or with different broadcasts ofthe same game). While FIG. 23A shows the game interaction module(s) 2310of spectating system 100 communicating with a game engine 2322 of a gamesystem 120 via the game system API 114, in some embodiments, the gameinteraction module(s) 2310 of spectating system 100 may insteadcommunicate with one or more game servers of the game system 120 toprovide game inputs 2396 to multiple game engine(s) 2322. The gameserver(s) may in turn communicate the game inputs 2396 to one, two, ormore game engine instances, as shown in FIG. 1D. The game engineinstances may be instantiated on one or more servers of the game system120, or alternatively at least some of the game engine instances may berunning on the broadcaster devices 140 as illustrated in FIG. 23A. Insome embodiments, the game inputs 2396 received from the gameinteraction module(s) 2310 of spectating system 100 may include at leastsome data specific to particular game engines (e.g., specific todifferent teams and/or players), and the game server(s) may handledistribution of the data to the target engines.

FIG. 24A is a flowchart of a method for allowing a spectator to provideinputs that affect a game being broadcast in a game spectating system,according to some embodiments. The method of FIG. 24A may, for example,be implemented by a spectating system 100 as illustrated in FIG. 1A,FIG. 1B, or FIG. 23. As indicated at 2400 of FIG. 24A, the spectatingsystem may provide game interaction broadcast content to a gameinteraction UI on a spectator device, for example as illustrated inFIGS. 23 and 25. The broadcast content may be based at least in part ongame metadata received from a game system, or from one or more othersources as illustrated in FIG. 1C. As indicated at 2402 of FIG. 24A, thespectating system may receive and process spectators' interactions withthe broadcast content to generate game inputs, for example asillustrated in FIG. 23. As indicated at 2404 of FIG. 24A, the spectatingsystem may provide the game inputs to the game via a game interface, forexample a game system API as illustrated in FIG. 23. As indicated at2406 of FIG. 24A, the game inputs may affect the game in various ways,for example as described in reference to FIGS. 23 and 25.

FIG. 24B is a flowchart of a method for analyzing spectator audio ortext inputs to affect a game being broadcast in a game spectatingsystem, according to some embodiments. The method of FIG. 24B may, forexample, be implemented by a spectating system 100 as illustrated inFIG. 1A, FIG. 1B, or FIG. 23. As indicated at 2450 of FIG. 24B, thespectating system may obtain audio and/or text inputs from spectators ofa broadcast, for example as illustrated in reference to FIGS. 26A and26B. In some embodiments, other inputs may be obtained by the spectatingsystem, such as social media inputs and inputs from devices andtechnologies such as controllers or joysticks, motion tracking systems,gesture-based input systems, and so on. As indicated at 2452 of FIG.24B, the spectating system may analyze the inputs to determine spectatorinputs directed to affecting the game. For example, keywords or keyphrases that indicate spectator instructions to the game system may bedetermined from analysis of text, audio, and/or other inputs such associal media inputs as illustrated in FIG. 4, which illustrates anexample participant input processing component of a spectating systemthat may obtain and analyze inputs including but not limited tospectator audio and/or text inputs or other inputs such as social mediainputs to determine broadcast-related analysis information. As indicatedat 2454 of FIG. 24B, the spectating system may generate game inputs fromthe spectator inputs, for example as illustrated in FIG. 23. Asindicated at 2456 of FIG. 24B, the spectating system may provide thegame inputs to the game via a game interface, for example a game systemAPI as illustrated in FIG. 23. As indicated at 2458 of FIG. 24B, thegame inputs may affect the game in various ways, for example asdescribed in reference to FIGS. 23 and 25.

FIG. 25 provides a non-limiting example of a spectating user interfacefor a game spectating system that allows spectators to provide inputsthat affect a game being broadcast via the game spectating system,according to some embodiments. A spectating UI 2502 may, for example bepresented as a Web page of a game spectating system website via a Webbrowser, as an interface to a game spectating Web application or mobileapplication, or as an interface to other network-based game spectatingapplications. A spectating UI 2502 may include one or more panes orregions including one or more of, but not limited to, controls 2510, avideo player 2532 with A/V controls 2533, a chat 2536 window, a gameinteraction pane 2540 via which spectators may view and interact withbroadcast content based at least in part on game metadata for the gamebeing broadcast 2534 to affect the game in various ways, and a communityinputs 2516 pane via which spectators can provide information tobroadcasters. Controls 2510 may include one or more UI elements fornavigating or otherwise interacting with the game spectating system.Video player 2532 displays the video stream (shown as broadcast 2534)for a live broadcast or channel or for a replay of a previously recordedbroadcast.

Game interaction pane 2540 may include broadcast content based at leastin part on the game metadata for the game being broadcast. The broadcastcontent displayed in game interaction pane 2540 may include interactiveUI elements via which spectators may affect the game being broadcast2534. As shown in this example for the “Space Explorers!” game, the gameinteraction pane 2540 may include one or more of, but is not limited to,UI elements via which spectators can add, build, or hide objects in thegame (e.g., buildings, terrain, weapons, other objects such as scrolls,information such as maps, etc.), UI elements via which spectators canaffect the game environment (e.g., the weather) in various ways, UIelements via which spectators can give selected players gear,information, or other game content, and UI elements via which spectatorscan set game parameters such as difficulty level, number of enemies, andso on. As shown in FIG. 25, the game interaction pane 2540 may alsoinclude a “Choose a player” UI element that the spectator may use toselect a player or players to give gear or other game content to. Insome embodiments, the spectator(s) may pay for the gear or other gamecontent, for example via a “Pay here” UI element as illustrated in FIG.25. In some embodiments, the game interaction pane 2540 may provide UIelements via which spectators may vote on one or more of thegame-altering options provided via the game interaction pane 2540.

In some embodiments, in addition to the broadcast content in the gameinteraction pane 2540 that allows spectators to interact with and affectgames in various ways, the spectating UI 2502 may provide one or more UIelements via which the spectators may individually or collectivelyprovide information to the broadcaster. For example, as shown in FIG.25, a community inputs 2516 pane includes “Look at:” UI elements viawhich a spectator can provide information to the broadcaster, in thisexample location information for a hidden object. Inputs to the UIelements on the spectator device may cause the input information to bedisplayed on the broadcaster's device, for example in a community inputspane as shown in FIG. 26B. The information may be, but is notnecessarily, displayed on other spectators' devices. Note that thespectator devices and broadcast device may also include broadcast chatwindows via which spectators and broadcaster can communicate, and thatthe spectating system may also support audio chat via an audio chatchannel, as illustrated in FIGS. 25, 26A, and 26B.

Referring to FIG. 23, spectators' interactions 164 with the broadcastcontent displayed in game interaction pane 2540 of the spectating UI2502 may be collected and analyzed by game interaction module(s) 2310 ofspectating system 100 to determine values for game inputs 2396 to thegame engine 2322. The game interaction module(s) 2310 collect andanalyze the spectator interactions 164, and provide the results to thegame engine 2322 as game inputs 2396. In addition, text inputs via achat 2536 window, audio chat, and other inputs may be analyzed, forexample as illustrated in reference to FIG. 4, to generate game inputs2396. The spectating community may thus influence game play in very realand visible ways in real- or near-real time via the spectating UI 2502provided by the spectating service 100, allowing the spectatingcommunity to view their influence on and thus sense their involvement inthe game. In addition, the game may be enhanced for the players byproviding interesting variations in game play that are influenced bytheir spectating audience.

FIG. 26A provides another non-limiting example of a spectating userinterface for a game spectating system that allows spectator andspectating community inputs to affect a game being broadcast via thegame spectating system, according to some embodiments. A spectator'sdevice 2600 may implement a spectating UI 2602, and may include amicrophone 2606 to collect spectator audio input and speakers 2604 tooutput game audio (including spectator audio and/or crowd noise,broadcaster audio commentary, etc.). The spectator's device 2600 mayalso include or be coupled to a keyboard 2609 or other input device(s)via which the spectator 2660 may enter text input such as broadcast chat2618. In some embodiments, the spectator's device 2600 may also includeor be coupled to input devices and technologies such as controllers orjoysticks, motion tracking systems, gesture-based input systems, and soon.

In some embodiments, UI 2602 may include a game spectating window 2610that displays a current view of the game universe, for example from thebroadcaster/player's perspective. In some embodiments, UI 2602 may alsoinclude a spectator controls 2619 window or pane via which the spectator2660 may interact with the spectating system to control the broadcast,select other broadcasts, and so on. In some embodiments, UI 2602 mayinclude a broadcast content 2640 pane or region in which broadcastcontent based at least in part on game metadata received from arespective game system may be displayed to and accessed by the spectator2660. The broadcast content 2640 pane may, for example, show informationabout the game, game players, game objects or items, game events, and soon as provided by the game system in the game metadata. In someembodiments, UI 2602 may include a broadcast chat 2618 window via whichthe spectator 2660 may communicate with the broadcaster/player and otherspectators via text.

In some embodiments, UI 2602 may include a window 2614 showing a liveview of the broadcaster/player, for example as a window within oroverlaying the game spectating window 2610. In some embodiments, a worldmap 2612 or portion of a map of the online game world may be displayedon UI 2602, for example as a window within or overlaying the gamespectating window 2610. In some embodiments, a window 2615 may show adifferent perspective of the game as selected by the spectator, oralternatively may show video on demand content such as highlight reelsor replays of previously recorded game sessions.

In some embodiments, UI 2602 may include a game interaction interface2644 via which the spectator may interact with UI elements to affect thegame in various ways, for example as described in reference to FIG. 25.In some embodiments, UI 2602 may also include a community inputs 2616interface via which the spectator may interact with UI elements tocommunicate with the broadcaster, for example as described in referenceto FIG. 25.

FIG. 26B provides a non-limiting example of a broadcaster user interfacefor a game spectating system that allows spectator and spectatingcommunity inputs to affect a game being broadcast via the gamespectating system, according to some embodiments. A broadcaster's device2650 may implement a game and broadcasting UI 2652, and may include orbe coupled to an A/V device 2656 (e.g., a video camera with microphone)to collect broadcaster/player 2670 audio and video input and speakers2654 to output game audio (including spectator audio and/or crowdnoise). The broadcaster's device 2650 may also include or be coupled toa keyboard 2659 or other input device(s) via which thebroadcaster/player 2670 may enter text input such as player chat orbroadcast chat. In some embodiments, the broadcaster's device 2650 mayalso include or be coupled to input devices and technologies such ascontrollers or joysticks, motion tracking systems, gesture-based inputsystems, and so on.

In some embodiments, broadcasting UI 2652 may include a game play window2660 that displays a current view of the game universe for thebroadcaster/player 2670. Note that the broadcaster's view of the gameuniverse as shown in window 2660 may be included in the broadcast andshown to spectators, for example as shown in FIG. 9. In someembodiments, UI 2652 may also include game controls 2669 via which thebroadcaster/player 2670 may interact with the game system. In someembodiments, UI 2652 may include in-game chat 2665 via which thebroadcaster/player 2670 may communicate to other players in the game viatext. In some embodiments, UI 2652 may also include broadcast controls2667 via which the broadcaster/player 2670 may interact with thespectating system to control the broadcast. In some embodiments, UI 2652may include broadcast chat 2668 via which the broadcaster/player 2670and spectators may communicate via text. In some embodiments, UI 2652may also include a community inputs 2666 pane via which informationprovided to specific broadcasters by spectators via the spectatinginterfaces as illustrated in FIGS. 25 and 26A may be displayed. In someembodiments, the provided information may instead or also be graphicallyprovided, for example as graphics in a world map overlay window 2662 asshown in FIG. 26B.

Collecting and Providing Game Spectating Data to Consumers

Embodiments of a spectating system are described that collect and storespectating data from broadcasts in a game spectating environment, andvend the collected data to consumers including but not limited to gamedevelopers, online merchants, and broadcasters. In some embodiments, thespectating system may obtain broadcasts including but not limited to A/Vcontent from broadcast devices. In some embodiments, the spectatingsystem may also obtain game metadata from game systems for which thebroadcasts are being streamed or from one or more other sources asillustrated in FIG. 1C. The spectating system stores audiovisual (A/V)content for broadcasts, and collects and stores spectating dataincluding but not limited to game metadata and spectator interactionswith the broadcasts and broadcast content. The spectating system exposesthe spectating data and A/V content to consumers, for example via a userinterface (UI), query interface, and/or an application programminginterface (API). The spectating system may provide the spectating datato consumers in raw or unprocessed form, for example via an API. Insteador in addition, the spectating system may perform processing andanalysis on at least some of the spectating data, and may provide accessto the processed data and/or analysis data via one or more interfacesincluding but not limited to query interfaces and UIs such as Web pages.

In some embodiments, the spectating data stored by the spectating systemmay also include broadcast or spectating statistics. The spectatingsystem may collect or determine the statistics based on spectatorparticipation in broadcasts and store the statistics data with the gamemetadata, spectator interaction data, and other spectating data. Forexample, in some embodiments, the spectating system may track the sizeof a particular broadcaster's audience, or the combined size of theaudiences for all broadcasters of a particular game. As another example,the spectating system may track subscribing spectators vs.non-subscribing spectators who are watching particular broadcasts orgames.

In some embodiments, audience or crowd state or emotion may be trackedby the spectating system, and may be stored as additional spectatingdata. For example, spectators' video, audio and/or textual inputs may beanalyzed as illustrated in FIG. 4 to detect content or emotion(keywords, cheers, boos, happiness, etc.); the analysis information maybe used to determine audience state or emotion metrics during thebroadcasts, and the metrics may be stored with the spectating data.

In some embodiments, speech recognition technology may be applied to oneor more of the audio inputs to broadcasts to recognize and convert thespoken words to text, and the text may be stored as additionalspectating data. For example, the broadcaster's audio channel may beconverted to text and stored as spectating data. As another example, theaudio channel for a commentator may be converted to text and stored asspectating data. The text may then be exposed to the consumers via theAPI, UI, and/or query interface, and may also be correlated temporallyto events in the game stream or to other spectating data such as thespectators' text chat inputs.

The spectating system may correlate the spectating data and A/V content,for example using timestamps, so that consumers can review portions ofvideo, audio, and/or text from broadcasts that may be related toparticular spectator behaviors, broadcast statistics (e.g., audiencesize), or spectating events as indicated by the respective spectatingdata. The spectating data may also be spatially mapped to the spectatinginterface so that consumers can determine spectator interest in andinteractions with various broadcast content. The spectating data mayinclude data for single broadcasts, broadcasters, or games, or formultiple broadcasts, broadcasters, or games.

In some embodiments the spectating system may store at least part of thegame metadata and broadcast metadata for broadcasts, including but notlimited to spectator interactions with respective broadcast content, asgame spectating data. The spectating system may also record audiovisual(A/V) content for at least some broadcasts. The game spectating systemmay provide one or more UIs, query interfaces, and/or APIs via whichconsumers (e.g., game developers) may obtain or view the game spectatingdata for individual broadcasts, broadcasters, or aggregated spectatingdata for broadcasts, broadcasters, or games. The spectating data may beanalyzed, presented, and viewed in various ways, and may be applied bythe consumers for various purposes, for example for use in analyzingonline game usage and performance for applications in game development,advertising, and/or marketing, or for use in analyzing vending ofgame-related content and merchandise via the spectating interface. Notethat the spectating system provider may also leverage the spectatingdata, for example to evaluate the spectating system UIs and UI content.For example, the spectating system provider may use heat maps asillustrated in FIG. 30 to evaluate layout and content of spectatinginterfaces.

In some embodiments, the spectating system may perform at least someprocessing and analysis on the spectating data, and may provideinterface methods (e.g., UIs) via which the consumers may obtain and/orview the pre-processed data. In some embodiments, the spectating systemmay instead or in addition provide an interface, for example a queryinterface, that allows the consumers to obtain, process, and analyze thespectating data according to their own custom purposes. The queryinterface may, for example, provide a query language that allows theconsumers to make queries or requests for information to a database ordata store that stores the spectating data, e.g. to perform searches ofthe spectating data.

FIG. 27 illustrates collecting and storing game spectating data in agame spectating system, according to some embodiments. As shown in FIG.27, a game spectating system 100 such as the spectating system 100 asillustrated in and described for FIGS. 1A, 1B, and 10 may implement oneor more broadcast processing modules 2700 that may collect and storebroadcast A/V content 2798 from broadcasts 142 including video, audio,and text (e.g., chat) channels, broadcast data 2796 including but notlimited to at least some of the game metadata 124 and broadcast metadatafor the broadcasts 142, and data 2794 describing spectator interactions164 with broadcasts 142 and broadcast content 126. Thespectating-related data may be stored to a spectating data store 2810.Spectating data store 2810 may be implemented by one or more storagedevices, systems, or services, for example by storage service(s)implemented as or by provider network services 4192 in a providernetwork 4190 as illustrated in FIG. 32.

The game spectating system 100 may implement one or more components ormodules 2700 that may present broadcast content 126 to spectators via aspectating UI 116 on respective spectator devices 160. The broadcastcontent 126 may be determined at least in part from game metadata 124received from the game system(s) 120 according to a game system API 114provided by the spectating system 100. In some embodiments, thebroadcast content 126 may be determined at least in part fromgame-related data acquired from one or more other sources such as onlinemerchants. The spectators may view, explore, discuss, select, and order,purchase, or otherwise obtain game-related content via the spectating UI116 and interactions with the broadcast content 126 presented on thespectator devices 160 according to the spectating UI 116. The module(s)2700 may obtain and process spectator interactions 164 with thebroadcast content 126 presented on the spectator devices 160 to generatespectator interaction data 2794.

In some embodiments, spectator interactions with the broadcasts 142 andbroadcast content 126 may be tracked, processed, and recorded asspectator interaction data 2794 in a spectating data store 2810. Thespectator interactions may include one or more of, but are not limitedto, selecting a UI element, manipulating a UI element (e.g., byscrolling, clicking, sliding, turning, etc.), hovering (e.g., with acursor) over or near a UI element, inputting to a UI element (e.g.,entering text in a text box), and focusing on one or more UI elements(e.g., as detected via eye tracking technology).

In some embodiments, obtaining and recording spectator interactions withthe broadcasts 142 and broadcast content 126 may include trackingspectator navigation to other pages or sites from the spectating UI. Forexample, in some embodiments, the spectating UI may be a Web pagepresented on a Web browser, and obtaining and recording spectatorinteractions with the broadcasts 142 and broadcast content 126 mayinclude tracking spectator navigation to one or more other Web pagesfrom the spectating UI.

In some embodiments, obtaining and recording spectator interactions withthe broadcasts 142 and broadcast content 126 may include tracking andrecording one or both of eye motion or head motion with respect to thespectating UI, broadcasts 142, and broadcast content 126.

FIG. 28 illustrates a game spectating module or service that exposesgame spectating data to consumers in a game spectating system, accordingto some embodiments. As shown in FIG. 27, a game spectating system 100such as the spectating system 100 as illustrated in and described forFIGS. 1A, 1B, and 10 may implement one or more broadcast processingmodules 2700 that may collect and store broadcast A/V content 2798 frombroadcasts 142 including video, audio, and text (e.g., chat) channels,broadcast data 2796 including but not limited to at least some of thegame metadata 124 and broadcast metadata for the broadcasts 142, anddata 2794 describing spectator interactions 164 with broadcasts 142 andbroadcast content 126. The spectating-related data may be stored to aspectating data store 2810. Spectating data store 2810 may beimplemented by one or more storage devices, systems, or services, forexample by storage service(s) implemented as or by provider networkservices 4192 in a provider network 4190 as illustrated in FIG. 32.

As shown in FIG. 28, a game spectating module 2800 may expose thebroadcast A/V content 2798, broadcast data 2796, and spectatorinteraction data 2794 to one or more spectating data consumers 2880 viaone or more spectating data interfaces 2802. The game spectating module2800 may be a module or service of a spectating system 100 asillustrated in FIG. 1A, 1B, or 27, or alternatively may be a separatemodule or service, for example a service implemented as or by providernetwork services 4192 in a provider network 4190 as illustrated in FIG.32.

Spectating data interfaces 2802 may include, but are not limited to,user interfaces (UIs) such as Web pages, query interfaces, and/orapplication programming interfaces (APIs). Via the interface(s) 2802,consumers 2890 may generate requests 2822 for spectating data 2832(including data from broadcast data 2796 and/or spectator interactiondata 2794) and/or broadcast A/V 2836.

In some embodiments, game spectating module 2800 may temporallycorrelate the broadcast A/V 2836 data and spectating data 2832, forexample using timestamps, so that consumers 2890 can review portions ofvideo, audio, and/or text (correlated broadcast A/V 2846) frombroadcasts that may be related to particular spectator behaviors orspectating events as indicated by respective (correlated) spectatingdata 2844. FIG. 31 shows an example of temporally correlating spectatingdata to broadcast A/V. In some embodiments, the spectating data 2844 mayalso be spatially mapped to the spectating UIs on which the broadcastsand broadcast content were presented so that consumers 2890 candetermine spectator interest in and interactions with various broadcastcontent, for example as shown in FIG. 30. The requested spectating data2844 and correlated broadcast A/V 2846 may include data and A/V forsingle broadcasts, broadcasters, or games, or for multiple broadcasts,broadcasters, or games.

FIG. 29 is a flowchart of a method for collecting game spectating dataand exposing the data to consumers in a spectating system, according tosome embodiments. The method of FIG. 29 may, for example, be implementedby a spectating system 100 as illustrated in FIGS. 1A, 1B, and 27. Asindicated at 2900 of FIG. 29, the spectating system may determinebroadcast content for respective broadcasts at least in part from gamemetadata, for example as described in reference to FIG. 1A, 1B, or 27.As indicated at 2910 of FIG. 29, the spectating system may stream thebroadcasts and broadcast content to spectator devices, for example asdescribed in reference to FIG. 1A, 1B, or 27.

As indicated at 2920 of FIG. 29, the spectating system may recordbroadcast A/V content, for example as described in reference to FIGS. 27and 28. As indicated at 2930 of FIG. 29, the spectating system maydetermine and record broadcast data as spectating data, for example asdescribed in reference to FIGS. 27 and 28. As indicated at 2940 of FIG.29, the spectating system may capture and record spectator interactionswith the broadcasts as spectating data, for example as described inreference to FIGS. 27 and 28.

As indicated at 2950 of FIG. 29, the broadcast A/V content may becorrelated with the spectating data, for example according to timestampsprovided as metadata with the A/V content and game metadata. In someembodiments, a game spectating module or service as illustrated in FIG.28 may perform the correlation, for example in response to consumerrequests for spectating data. As indicated at 2960 of FIG. 29, thespectating data may be exposed to consumer(s) via a UI, API, and/orquery interface, for example via the interface(s) as illustrated in FIG.28. As indicated at 2970 of FIG. 29, the spectating system may providebroadcast A/V content correlated with the spectating data to theconsumer(s) via the UI, API, and/or query interface, for example inresponse to requests to the interface(s) as illustrated in FIG. 28.

As indicated by the arrow returning from element 2950 to element 2900,in at least some embodiments, the method of FIG. 29 may be an iterativeprocess in which spectating data and A/V content for broadcasts isobtained, stored and correlated to be exposed to consumer(s) via theinterfaces.

FIG. 30 is a non-limiting example of a game spectating data consumerinterface that shows a heat map overlaid on a spectating interface 3002template or layout indicating spectator interactions with broadcastcontent during at least a portion of a broadcast, according to someembodiments. FIG. 30 shows an example spectating UI 3002 template orlayout that may include a video player 3032 with controls 3033 and abroadcast 3034 pane, a highlight 3034 pane, and a chat 3036 pane, forexample as illustrated in FIG. 6A. The spectating UI 3032 may alsoinclude a games 3050 pane showing one or more games 3052, a channels3060 pane showing one or more broadcasters 3062, and a video on demand3070 pane showing one or more videos 3072 such as previously recordedbroadcasts and highlight reels, for example as illustrated in FIG. 6A.The spectating UI 3032 may also include a game merchandising interface3040 that includes UI elements for obtaining game-related content andmerchandise, for example as illustrated in FIG. 12. The spectating UI3032 may also include other broadcast content 3037 as described herein,for example UI elements for obtaining, joining, or stepping into gamesas illustrated in FIG. 14. The broadcast content for the respectivebroadcast for which this heat map was generated may also include one ormore overlays 3037 on the broadcast 3034, for example text or banner adsadded to the broadcast stream by the spectating system as illustrated inFIGS. 1A and 27 or by a broadcast content service as illustrated in FIG.1B.

A heat map is overlaid on the spectating interface 3002 that showsspectator activity relative to the interface 3002 as illustrated by theshaded areas. The heat map may indicate activity during a broadcast orportion of a broadcast, or during two or more broadcasts. While shown ingrayscale, with darker shading indicating areas of higher activity, inpractice the shading may be in color, for example with “hotter” colorsindicating higher activity. The shaded areas correspond to regions orcontent of the spectating interface 3002 that the spectators tended tofocus on or interact with during a broadcast or portion of a broadcast,or during two or more broadcasts, as determined by analysis of thespectating data 2834 as illustrated in FIG. 28, for example spectatorinteraction data 2794 collected for one, two, or more broadcasts.Spectator interactions with the spectating interface 3002 that aretracked and analyzed to generate the heat map may include one or moreof, but are not limited to, selecting a UI element, manipulating a UIelement (e.g., by scrolling, clicking, sliding, turning, etc.), hovering(e.g., with a cursor) over or near a UI element, inputting to a UIelement (e.g., entering text in a text box), and focusing on one or moreUI elements (e.g., as detected via eye tracking technology).

The heat map may, for example indicate items in a merchandisinginterface 3040 that spectators tended to focus on but not purchase(e.g., items 2 and 3), or tended to purchase more often than other items(e.g., item 1). As another example, the heat map may indicate games3052, broadcasters 3062, and/or videos 3072 that tend to generate moreor less activity. The heat map may also indicate regions in thebroadcast 3034 that tend to generate more activity. Consumers may, forexample, use this information to evaluate spectating interface 3002content and layout including but not limited to products, productplacement, advertisements, and so on. As non-limiting examples,broadcasters may use the heat map to evaluate content they select toplace on their channels, and game developers and/or online merchants mayuse the heat map to evaluate game-related content and merchandise thatis vended via the spectating interface 3002.

While FIG. 30 shows the heat map as static, in some embodiments the heatmap may be dynamic; the recorded spectator interactions may be playedback, with the heat map changing to reflect changes in focus. Inaddition, the spectating data from which the heat map is generated maybe temporally correlated with the A/V content for the broadcast(s), andthe A/V content may be played back with the heat map display, which forexample may allow the consumer can see and hear what was happeningduring the broadcast(s) during periods of high and/or low activity.

FIG. 31 is a non-limiting example of a game spectating data consumerinterface 3102 provided to a consumer 3160's device 3100 that shows gamespectating metrics correlated with broadcast A/V content, according tosome embodiments. Spectating data controls 3140 may, for example,include various UI elements that allow the consumer 3160 to controldisplay and content of the interface 3102, for example UI elements thatallow the consumer 3160 to query the spectating data module or serviceas illustrated in FIG. 28. Metric graph panes 3110A and 3110B show plotsof spectating metrics A and B, respectively, over time. Spectatingmetrics A and B may be any of various metrics determined from spectatingdata 2834 as illustrated in FIG. 28. As non-limiting examples, metric Amay indicate audience size, and metric B may indicate an audienceexcitement or activity metric, plotted over time. Spike 3111 indicates ahigh point in the metrics plotted in 3110A and 3110B. Spectating datametrics 3116 may textually display values for one or more metrics (X, Y,and Z, in this example) determined from spectating data 2834 obtainedfrom the spectating data store via the spectating data module or serviceas illustrated in FIG. 28. Pane 3112 may replay video from the broadcastthat corresponds to the metrics plotted in 3110A and 3110B and shown inspectating data metrics 3116. Broadcast text chat 3118 may replay thetext chat from the broadcast displayed in pane 3112. In addition,broadcast audio corresponding to the broadcast may be replayed viaspeaker(s) 3104. Some or all of the data or information visually oraudibly provided via elements 3110A and 3110B, 3112, 3118, 3116, and3104 may be temporally correlated so that the consumer 3160 may view andhear what was happening during the broadcast 3112 and/or at particularmoments in the broadcast 3112, such as at spike 3111. For example, theconsumer 3160 may use this example interface to correlate particularevents in the broadcast A/V content with audience activities, spectatorinteractions and inputs, spectating statistics, and other informationfrom the spectating data.

Example Network-Based Game Spectating Environments

FIG. 32 illustrates an example network-based game and game spectatingenvironment, according to some embodiments. Embodiments of game systems,game spectating systems, and other systems and services in gamespectating environments as described herein in reference to FIGS. 1Athrough 29 may be implemented in the context of a service provider thatprovides virtualized resources (e.g., virtualized computing resources,virtualized storage resources, virtualized database (DB) resources,etc.) on a provider network 4190 to clients of the service provider, forexample as illustrated in FIG. 32. Virtualized resource instances may beprovisioned via one or more provider network services 4192, and may berented or leased to the clients of the service provider, for example todeveloper 4170 clients that develop and provide game systems 4100 orother systems or services via the provider network 4190 and services4192.

In at least some embodiments, one or more developers 4170 may access oneor more of services 4192 of the provider network 4190 via applicationprogramming interfaces (APIs) to the services 4192 to configure a gamesystem 4100 and/or game spectating service 4130 on the provider network4190. A game system 4100 or game spectating service 4130 may includemultiple virtualized resource instances (e.g., computing resources,storage resources, DB resources, etc.).

At least some of the resource instances on the provider network 4190(e.g., computing resources) may be implemented according to hardwarevirtualization technology that enables multiple operating systems to runconcurrently on a host computer, i.e. as virtual machines (VMs) on thehost. The provider network 4190, via the services 4192, may enable theprovisioning of logically isolated sections of the provider network 4190to particular clients as client private networks on the provider network4190. At least some of a client's resources instances on the providernetwork 4190 may be provisioned in the client's private network. Forexample, in FIG. 32, one or more game systems 4100 may be implemented asor in private networks of respective developers 4170 that areprovisioned on provider network 4190 via one or more of the services4192. As another example, a game spectating service 4130 may beprovisioned in private networks on provider network 4190 via one or moreof the services 4192.

The provider network 4190, via the services 4192, may provide flexibleprovisioning of resource instances to clients in which virtualizedresource instances can be automatically added to or removed from aconfiguration on the provider network 4190 in response to changes indemand or usage, thus enabling an implementation on the provider network4190 to automatically scale to handle computation and/or storage needs.For example, one or more additional computing and/or storage resourcesmay be automatically added to a game system 4100 and/or to gamespectating service 4130 in response to an increase in game playing,broadcasting, and/or game spectating from player/broadcaster devices4120 and/or spectator devices 4180. Conversely, if and when usage dropsbelow a threshold, resources can be removed from a game system 4100and/or game spectating service 4130.

Illustrative System

In at least some embodiments, a computing device that implements aportion or all of the methods and apparatus for integrating game systemswith a game spectating system in game spectating environments asdescribed herein may include a general-purpose computer system thatincludes or is configured to access one or more computer-accessiblemedia, such as computer system 4300 illustrated in FIG. 33. In theillustrated embodiment, computer system 4300 includes one or moreprocessors 4310 coupled to a system memory 4320 via an input/output(I/O) interface 4330. Computer system 4300 further includes a networkinterface 4340 coupled to I/O interface 4330.

In various embodiments, computer system 4300 may be a uniprocessorsystem including one processor 4310, or a multiprocessor systemincluding several processors 4310 (e.g., two, four, eight, or anothersuitable number). Processors 4310 may be any suitable processors capableof executing instructions. For example, in various embodiments,processors 4310 may be general-purpose or embedded processorsimplementing any of a variety of instruction set architectures (ISAs),such as the x86, PowerPC, SPARC, or MIPS ISAs, or any other suitableISA. In multiprocessor systems, each of processors 4310 may commonly,but not necessarily, implement the same ISA.

System memory 4320 may be configured to store instructions and dataaccessible by processor(s) 4310. In various embodiments, system memory4320 may be implemented using any suitable memory technology, such asstatic random access memory (SRAM), synchronous dynamic RAM (SDRAM),nonvolatile/Flash-type memory, or any other type of memory. In theillustrated embodiment, program instructions and data implementing oneor more desired functions, such as those methods, techniques, and datadescribed herein for integrating game systems with a game spectatingsystem in a game spectating environment, are shown stored within systemmemory 4320 as code 4325 and data 4326.

In one embodiment, I/O interface 4330 may be configured to coordinateI/O traffic between processor 4310, system memory 4320, and anyperipheral devices in the device 4300, including network interface 4340,input/output (I/O) devices, or other peripheral interfaces. In someembodiments, I/O interface 4330 may perform any necessary protocol,timing or other data transformations to convert data signals from onecomponent (e.g., system memory 4320) into a format suitable for use byanother component (e.g., processor 4310). In some embodiments, I/Ointerface 4330 may include support for devices attached through varioustypes of peripheral buses, such as a variant of the Peripheral ComponentInterconnect (PCI) bus standard or the Universal Serial Bus (USB)standard, for example. In some embodiments, I/O interface 4330 maysupport one or more input/output peripheral devices or components 4370of system 4300, such as cursor control, keyboard, display, video, and/oraudio I/O devices 4370 or components, and/or input devices such ascontrollers or joysticks, motion tracking systems, and gesture-basedinput systems. In some embodiments, the function of I/O interface 4330may be split into two or more separate components, such as a northbridge and a south bridge, for example. Also, in some embodiments someor all of the functionality of I/O interface 4330, such as an interfaceto system memory 4320, may be incorporated directly into at least oneprocessor 4310.

Network interface 4340 may be configured to allow data to be exchangedbetween computer system 4300 and other devices 4360 attached to anetwork or networks 4350, such as other computer systems or devices asillustrated in FIGS. 1A through 30, for example. In various embodiments,network interface 4340 may support communication via any suitable wiredor wireless general data networks, such as types of Ethernet network,for example. Additionally, network interface 4340 may supportcommunication via telecommunications/telephony networks such as analogvoice networks or digital fiber communications networks, via storagearea networks such as Fibre Channel SANs, or via any other suitable typeof network and/or protocol.

In some embodiments, system memory 4320 may be one embodiment of acomputer-accessible medium configured to store program instructions anddata as described above for FIGS. 1A through 30 for implementingembodiments of methods and apparatus for integrating game systems with agame spectating system in a game spectating environment. However, inother embodiments, program instructions and/or data may be received,sent or stored upon different types of computer-accessible media.Generally speaking, a computer-accessible medium may includenon-transitory storage media or memory media such as magnetic or opticalmedia, e.g., disk or DVD/CD coupled to computer system 4300 via I/Ointerface 4330. A non-transitory computer-accessible storage medium mayalso include any volatile or non-volatile media such as RAM (e.g. SDRAM,DDR SDRAM, RDRAM, SRAM, etc.), ROM, etc., that may be included in someembodiments of computer system 4300 as system memory 4320 or anothertype of memory. Further, a computer-accessible medium may includetransmission media or signals such as electrical, electromagnetic, ordigital signals, conveyed via a communication medium such as a networkand/or a wireless link, such as may be implemented via network interface4340.

CONCLUSION

Various embodiments may further include receiving, sending or storinginstructions and/or data implemented in accordance with the foregoingdescription upon a computer-accessible medium. Generally speaking, acomputer-accessible medium may include storage media or memory mediasuch as magnetic or optical media, e.g., disk or DVD/CD-ROM, volatile ornon-volatile media such as RAM (e.g. SDRAM, DDR, RDRAM, SRAM, etc.),ROM, etc., as well as transmission media or signals such as electrical,electromagnetic, or digital signals, conveyed via a communication mediumsuch as network and/or a wireless link.

The various methods as illustrated in the Figures and described hereinrepresent exemplary embodiments of methods. The methods may beimplemented in software, hardware, or a combination thereof. The orderof method may be changed, and various elements may be added, reordered,combined, omitted, modified, etc.

Various modifications and changes may be made as would be obvious to aperson skilled in the art having the benefit of this disclosure. It isintended to embrace all such modifications and changes and, accordingly,the above description to be regarded in an illustrative rather than arestrictive sense.

What is claimed is:
 1. A system, comprising: one or more computingdevices configured to implement a spectating system configured to:obtain one or more broadcasts from one or more broadcaster devices,wherein each broadcast shows game play of a respective broadcasterparticipating as a player in a game executing on a game system; generatebroadcast content for the one or more broadcasts at least in partaccording to game metadata for the game received from the game system;stream the one or more broadcasts and the broadcast content to aplurality of spectator devices; record audiovisual (AN) content for thebroadcasts; obtain and store spectator interactions with the broadcastsand broadcast content as spectating data; determine spectating datametrics indicating spectator states during the broadcasts based at leastin part on analysis of the spectating data; store correlations betweenthe spectating data and the A/V content according to the spectating datametrics; and expose the spectating data, the spectating data metrics andthe A/V content to one or more spectating data consumer devicesaccording to a spectating data interface.
 2. The system as recited inclaim 1, wherein the spectating system is further configured to store atleast part of the game metadata for the broadcasts as spectating data,wherein the game metadata includes one or more of game states for thegame, game event data for the game, or data describing or representinggame content.
 3. The system as recited in claim 1, wherein the broadcastcontent includes one or more of content overlaid on game video receivedfrom the broadcaster devices or UI elements provided to the plurality ofspectator devices for display according to a spectating UI, and whereinthe spectator interactions with the broadcast content indicate spectatorinterest in or selections of the respective broadcast content.
 4. Thesystem as recited in claim 1, wherein the broadcast content includesuser interface (UI) elements for viewing and purchasing virtual orphysical objects including objects related to the game, and wherein thespectator interactions include interactions with the UI elementsindicating spectator interest in or purchases of respective objects. 5.The system as recited in claim 1, wherein the A/V content for abroadcast includes one or more of broadcast video, broadcast audio, orbroadcast text chat.
 6. The system as recited in claim 1, wherein thespectating system is further configured to: receive an indication ofparticular spectating data from a consumer device according to thespectating data interface; determine a portion of the A/V content thatis correlated to the particular spectating data; and provide thecorrelated portion of the A/V content to the consumer device accordingto the spectating data interface.
 7. The system as recited in claim 1,wherein the spectating data interface includes one or more of anapplication programming interface (API) a user interface (UI), or aquery interface.
 8. A method, comprising: performing, by a spectatingsystem implemented on one or more computing devices: streaming one ormore broadcasts received from one or more broadcaster devices to aplurality of spectator devices, wherein each broadcast includes gameplay of a respective broadcaster participating as a player in a gameexecuting on a game system; providing broadcast content to the spectatordevices with the one or more broadcasts, wherein the broadcast contentis determined at least in part according to game metadata for the gamereceived from the game system; obtaining and recording spectatorinteractions with the one or more broadcasts and respective broadcastcontent as spectating data; determine spectating data metrics indicatingspectator states during the one or more broadcasts based at least inpart on analysis of the spectator interactions with the one or morebroadcasts and the respective broadcast content; storing correlationsbetween the spectating data and the one or more broadcasts according tothe spectating data metrics; and exposing the spectating data and thespectating data metrics to one or more spectating data consumersaccording to a spectating data interface.
 9. The method as recited inclaim 8, further comprising: recording audiovisual (A/V) content for theone or more broadcasts; and determining the correlations between thespectating data and the A/V content according to the spectating datametrics.
 10. The method as recited in claim 9, wherein the A/V contentfor a broadcast includes one or more of broadcast video, broadcastaudio, or broadcast text chat.
 11. The method as recited in claim 8,further comprising: recording audiovisual (A/V) content for the one ormore broadcasts; receiving an indication of particular spectating datafrom a consumer device according to the spectating data interface;determining a portion of the A/V content that is correlated to theparticular spectating data; and providing the correlated portion of theA/V content to the consumer device according to the spectating datainterface.
 12. The method as recited in claim 8, further comprisingstoring at least part of the game metadata for the broadcasts asspectating data, wherein the game metadata includes one or more of gamestates for the game, game event data for the game, or data describing orrepresenting game content.
 13. The method as recited in claim 8, furthercomprising: determining spectating statistics for the one or morebroadcasts based on spectator participation in the broadcasts; andstoring the spectating statistics with the spectating data.
 14. Themethod as recited in claim 8, wherein the broadcast content includes oneor more of content overlaid on game video received from the broadcasterdevices or UI elements provided to the plurality of spectator devicesfor display according to a spectating UI, and wherein the spectatorinteractions with the broadcast content indicate spectator interest inor selections of the respective broadcast content.
 15. The method asrecited in claim 8, wherein the broadcast content includes userinterface (UI) elements for viewing and purchasing virtual or physicalobjects including objects related to the game, and wherein the spectatorinteractions include interactions with the UI elements indicatingspectator interest in or purchases of respective objects.
 16. The methodas recited in claim 8, further comprising: analyzing the spectating datato determine spectating information for at least one of the broadcasts;and providing the spectating information to at least one of thespectating data consumers according to the spectating data interface.17. The method as recited in claim 16, wherein the spectatinginformation includes a heat map that indicates spectator interest in thebroadcast and respective broadcast content based on the spectatorinteractions with the broadcast and respective broadcast content. 18.The method as recited in claim 8, wherein the spectating data consumersinclude one or more of game developers, broadcasters, or onlinemerchants.
 19. The method as recited in claim 8, wherein the spectatingdata interface includes one or more of an application programminginterface (API), a user interface (UI), or a query interface.
 20. Themethod as recited in claim 8, wherein said obtaining and recordingspectator interactions with the broadcasts and broadcast contentcomprises tracking and recording interactions with a spectating userinterface (UI) of the spectating system on respective spectator devices.21. The method as recited in claim 20, wherein the spectating UI is aWeb page presented on a Web browser, and wherein said obtaining andrecording spectator interactions with the broadcasts and broadcastcontent further comprises tracking spectator navigation to one or moreother Web pages from the spectating UI.
 22. The method as recited inclaim 20, wherein tracking and recording interactions with thespectating UI on at least one spectator device comprises tracking andrecording one or both of eye motion or head motion with respect to thespectating UI.
 23. The method as recited in claim 8, wherein thespectating data includes data specific to a broadcast, a plurality ofbroadcasts, a game, or a plurality of games.
 24. A non-transitorycomputer-readable storage medium storing program instructions that whenexecuted on one or more computers cause the one or more computers toimplement a spectating data service for a spectating system configuredto: store spectating data including indications of spectatorinteractions with a plurality of broadcasts and respective broadcastcontent, wherein each broadcast includes game play of a respectivebroadcaster participating as a player in a game executing on a gamesystem, and wherein the broadcast content is determined at least in partaccording to game metadata for the game received from the game system;store audiovisual (A/V) content for the broadcasts, wherein the A/Vcontent for a broadcast includes one or more of broadcast video,broadcast audio, or broadcast text chat; analyze the spectating data andthe A/V content to determine spectating data metrics indicatingspectator states during the broadcasts; expose the spectating data, thespectating data metrics and the A/V content to one or more spectatingdata consumers according to a spectating data interface; receive arequest for particular spectating data from a spectating data consumeraccording to the spectating data interface; determine a portion of theA/V content that is correlated to the particular spectating dataaccording to the spectating data metrics; and provide the requestedspectating data and the correlated portion of the A/V content to theconsumer according to the spectating data interface.
 25. Thenon-transitory computer-accessible storage medium as recited in claim24, wherein the spectating data service is further configured to:analyze the spectating data to determine spectating information specificto a broadcast, a plurality of broadcasts, a game, or a plurality ofgames; and provide the spectating information to at least one of thespectating data consumers according to the spectating data interface.